Connecting to Data Sources
Data sources in the Aria platform enable you to integrate data from various origins into your Agent. Once a data source is added, the data undergoes ingestion, encoding, and storage in vector databases, making it ready for subsequent ragging and tooling operations.
Data Source connectors can be used to ingest different files, and use them as your knowledge in an Agent.
File Types supported
Our various Data Sources support a variety of different file types, including:
- Office Documents*
- Word Documents
- Excel Files*†
- Powerpoint Files
- JSON†
- CSV†
- Markdown
- Images
- JPEG/JPG
- PNG
- BMP
- TIFF
- HEIF*‡
- PlainText files
- PDF§
* Word, Excel and Powerpoint supported as DOCX/DOC, XLSX/XLS and PPTX/PPT respectively
† JSON files are supported as text only. Excel and CSV files are supported as text (file size limit is 50MB) and SQL (file size limit is 100MB).
‡ HEIF files aren't supported for Microsoft connectors due to how files are processed
§ Supported in Text-only mode or Text with Images
File Upload supported file types and sizes:
All file types listed above are supported for File upload provided file size is up to 50MB.
Files which content is script (PHP, JS, etc) are not supported regardless of their file type. Such files can be ingested via any other connector.
How to Add a New Data Source
- Navigate to the Data Sources sub-menu within your project.
- Click on New Data Source.
- Browse the connector library and select the appropriate data source.
- Provide a name and fill out any additional required fields specific to the selected data source type.
- Choose the Database, Embedding Model, and Chunking Strategy that best suits your data source.
Airia Connector Library
Managing a Data Source
After a data source has been created, it can be easily managed from the list view. Selecting a data source will allow you to view and edit key details, review the data ingested from that source, and adjust the ingest setup as needed. For file-based data sources, you can also upload files directly to the platform in this section.
Edit a Data Source
Additional Resoures
We have created tutorials on how to manage data sources and updating your data sources to help.