Langchain offers a variety of document loaders for many sources. Langchain loaders have a similar load method to Neum data connectors. The output of the method is a Langchain Document vs a Neum Document. We offer helpers to transform documents.
Copy
!pip install neumai-toolsfrom neumai_tools.InteropHelpers.DocumentTransformer import document_transformer_llamaIndexfrom llama_index import SimpleDirectoryReaderdocuments = SimpleDirectoryReader("./data").load_data()neum_documents = [document_transformer_llamaIndex(document) for documents in documents]