Skip to main content

 

ThoughtSpot

Add a new data source

Data Connect video

 

Now that you've enabled ThoughtSpot Data Connect, you will be able to add a new data source. Data sources are the source systems from which you want to import data and schedule repeat data loads.

Data sources can consist of:
  • Relational database sources, like SQL Server.
  • Applications, like Marketo or Salesforce.

To add a data source:

  1. Log in to ThoughtSpot from a browser.
  2. Click on Data, on the top navigation bar.

    Figure: Data

    File:Integration_Guides/Data_Connect_Guide_3.5/010/030/data_icon.png
  3. Click the Data Sources tab at the top of the page, and select + New data source on the upper right hand side of the panel.

    Figure: New data source

    File:Integration_Guides/Data_Connect_Guide_3.5/010/030/data_sources_tab.png
  4. Select which type of connection you wish to use from the available list.
  5. Select a connection type and click Next.

    Figure: Select a connection type

    File:Integration_Guides/Data_Connect_Guide_3.5/010/030/lightweight_etl_select_connection.png
  6. To select a connection, choose one of these options:
    • Select a pre-defined connection type, by choosing it from the Select Connection list:

      Figure: Select a connection type

      File:Integration_Guides/Data_Connect_Guide_3.5/010/030/lightweight_etl_select_existing_connection.png
    • Click + to create the connection and provide the credentials to your data source. Then click Test & Create:

      Figure: Create a connection

      File:Integration_Guides/Data_Connect_Guide_3.5/010/030/lightweight_etl_create_new_connection.png
    Refer to the Data Connect connectors reference for more information on each of the specific attributes you must enter into the dialog box.
  7. Choose the tables you wish to load from the list of Available Tables.
    Restriction: Only the first 200 objects that occur alphabetically will be listed per schema. If you want to access a table that falls below the first 200 objects alphabetically, you must use the object search bar.

    Figure: Object search bar

    File:Integration_Guides/Data_Connect_Guide_3.5/010/030/data_connect_object_search_bar.png
    Here are examples of the user and system performed search patterns for this object search bar:
    • User enters KNA, then the system performs a search for %KNA%.
    • User enters KNA*, then the system performs search for KNA%.
    • User enters *KNA, then the system performs search for %KNA.
    • User enters "KNA", then the system performs exact match search for KNA.
    Select the specific columns to import.

    Figure: Selecting tables and columns

    File:Integration_Guides/Data_Connect_Guide_3.5/010/030/lightweight_etl_select_columns.png
  8. When all the columns are selected, click > to move them to the Selected Tables box. Click Next.
  9. You can optionally apply a filter to only import specific rows by clicking New... under Data Filters.
    1. Select a table to filter.
    2. Select a filter by specifying a column, operator, and value.

      Figure: Apply a Data Filter

    3. Click OK.
    4. You can create as many filters as you need by clicking + and repeating these steps.
  10. You can optionally apply data transformations and write the result to a new column by clicking New... under Expressions.
    1. Give the new column an alphanumeric name (underscores are okay). You can rename it later in the ThoughtSpot application.
    2. Select the table and column the data will come from.
    3. Type in an expression.
      You can see a list of expressions by clicking the Expression assistant.

      Figure: Apply an Expression

      File:Integration_Guides/Data_Connect_Guide_3.5/010/030/lightweight_etl_expression.png
    4. Click Add Column.
    5. Click Validate to validate your expression before creating the data source.
    6. You can create as many expressions as you need by clicking + and repeating these steps.
  11. Click Next.
  12. Provide a Source Name for the data source.
  13. Check the list of columns to be imported, to make sure it is correct. If you are loading into new or empty tables, or if you want to delete any data that already exists in the tables, click the checkbox to select Truncate data in the existing tables.
  14. If you want to specify repeat data loads, create a loading schedule.

    Figure: Schedule a loading job

  15. If you want to receive an email notification letting you know when your data load completes, select Enable email notifications for data load tasks.
    Note: Email notifications will only be sent to the respective email address of the user who created the data source. You can't send notifications to multiple email addresses.
    In order to receive email notifications, you must enable Email me sharing notifications in your Profile Preferences. You also need to have an email set in your user properties found on the Admin User Management page.
  16. Click Import.
  17. If you want to view or change the SQL DDL (data definition language) that will create the target table, click here.

    Figure: Edit schema here

    File:Integration_Guides/data_connect_guide_bookmap/010/030/data_connect_edit_schema.png
  18. Review and edit the schema as necessary. Click Load to load the tables.

    Figure: Edit schema view

    File:Integration_Guides/data_connect_guide_bookmap/010/030/data_connect_edit_schema_view.png
  19. Click Load.
Your data source will appear on the Data Sources list page, and you can find the imported tables on the Tables list page. Tables imported via ThoughtSpot Data Connect display the job name in the Source column.
  • Was this article helpful?