Browse All Recipes (142)

Learning Stream Reader Example
This recipe enables you to read data from a Learning Stream
Canvas - Update SIS user id
This recipe enables you to update data from a Canvas
PeopleSoft to Salesforce: Application Sync
This recipe syncs approved applicant data from a PeopleSoft staging table back to Salesforce.
Salesforce to PeopleSoft: Application Sync
This recipe syncs Application Data from Salesforce to a PeopleSoft staging table. Applications are then reviewed and processed manually.
Salesforce to Peoplesoft: Academic Advisor Sync
This recipe retrieves academic advisor emplid from Salesforce and writes the data back to Peoplesoft
Peoplesoft to Salesforce: Course Connection Sync
This recipe retrieves Course Connection from Peoplesoft and writes the data back to Salesforce
HTTP Connector - Basic GET Example
This recipe demonstrates how to retrieve data from an API endpoint through a basic HTTP GET request
Peoplesoft to Salesforce: Test and Score Sync
12 - Peoplesoft to Salesforce: Test and Score Sync - This recipe retrieves Test and Score Sync from Peoplesoft and writes back to Salesforce
Peoplesoft to Salesforce: Education History Sync
Peoplesoft to Salesforce: Education History Sync - This recipe retrieves Education History Sync from Peoplesoft and writes the data back to Salesforce
Peoplesoft to Salesforce: Student Service Indicator Sync
Peoplesoft to Salesforce: Student Service Indicator Sync - This recipe retrieves Student Service Indicator Sync from Peoplesoft and writes the data back to Salesforce
PeopleSoft to Salesforce - Student Account
PeopleSoft to Salesforce - Student Account Sync - This recipe retrieves Student Account Sync from Peoplesoft and writes the data back to Salesforce
PeopleSoft to Salesforce - Program Enrollments
PeopleSoft to Salesforce - Program Enrollments - This recipe retrieves Program Enrollments from Peoplesoft and writes the data back to Salesforce
PeopleSoft to Salesforce - Courses
PeopleSoft to Salesforce - Courses - This recipe retrieves Courses from Peoplesoft and writes the data back to Salesforce
PeopleSoft to Salesforce - University Picklist
PeopleSoft to Salesforce - University Picklist - This recipe retrieves University Picklist from Peoplesoft and writes the data back to Salesforce
Peoplesoft to Salesforce: Degree Picklist
Peoplesoft to Salesforce: Degree Picklist - This recipe retrieves Degree Picklist from Peoplesoft and writes the data back to Salesforce
Peoplesoft to Salesforce: Terms
Peoplesoft to Salesforce: Terms - This recipe retrieves terms from Peoplesoft and writes the data back to Salesforce
PeopleSoft to Salesforce: External SchooAccount
School Account Recipe - This recipe retrieves external school accounts from Peoplesoft and writes the data back to Salesforce
Build a recipe with multiple instances of the same connector
This recipe shows how build a recipe with multiple instances of the same connector
Custom Output via Imports
This recipe shows a scenario where you need to create a custom format out that differs from a traditional single row output, use the recipe 'Import' section to create custom output formats.
Graph QL Reader
This recipe demonstrates how to utilize Lingk's GraphQL reader to read data from GraphQL endpoints.
Append File Task
This recipe utilizes the Append task to append data from one source to a flat file output.
Web Socket Adapter Reader
This recipe demonstrates how to read data from a Web Socket connection. Simply adjust the 'rootUrl' and 'query' parameter on the websocketAdapterReader connector to customize your connector.
Canvas Catalog Reader
This recipe shows how to read data from a Canvas Catalog endpoint. Simply replace the root URL to read in your data.
Date Transformation - SQL Function Examples
This recipe demonstrates how to use a variety of different SQL based date functions that can be utilized for Date transformations.
Update an Environment Variable in a Recipe
This recipe shows how to update an environment variable in a recipe
Using SQL date functions to get new values
This recipe shows you how to utilize SQL logic to find a date differential from the current timestamp to a recipe run start time.
Read accumulated Logs by Organization
This recipe shows you how to read out the accumulated custom logs for your organization.
Logging custom data of recipe executions
This recipe shows you how to use the 'log' function to create a custom log that writes data to a custom log file. This log file can then be utilized by recipes to output whatever custom data is stored.
Writing Errors to a Salesforce Error Object
This recipe exhibits a pattern where you can utilize the 'error' response on Salesforce updates/inserts to update a Salesforce error object for issue tracking.
How to create a date-time variable or interval
This recipe demonstrates how to generate a date-time value relative to the current date-time. For example, if a recipe needs a date-time that is 15 days prior to the current date-time, this can be accomplished programattically in your statement section using SQL Functions.
Setting a page limit on the Ethos Connector
This recipe shows how you can set a page limit on the Ethos Reader Connector.
How to Stop a recipe via the 'Stop' Statement
This recipe shows how you can utilize a 'stop' statement to stop your recipe at a certain point in the recipe runtime.
De-duplication Task - JSON Example
This recipe shows how our De-duplication Task can find differences between two data sets.
Selecting Nested Data in Recipes
This recipe shows a quick example of how to select nested data using dot notation.
EdFi API Connection Test
This recipe reads data from a sample of EdFi API endpoints. Set up your EdFi connection in your environment before running. The Student API endpoint will be called when you run the recipe.
Escape Special Characters in 'parameterizedBy' connector property
When you pass special characters to a 'parameterizedBy' connector property in a recipe it can encounter an issue if it contains un-escaped special characters. This recipe demonstrates how to escape special characters using our SQL escape key of '//'.
Salesforce to Anthology - Student Creation
This recipe will select new students from salesforce and created them into Anthology. Recipe Steps -Select records from salesforce WHERE Sync_Status_SIS__c = 'Ready For Export'. -Reject records whith Null or blank required fields. -Create json payload for Anthology SaveNew end point to create new student by HTTP writer. -Parse Anthology HTTP writer response. -Select Id and student number from response and update in respective record into Salesforce. -Log error records.
Get Salesforce documents base64encoded string
This recipe uses our HTTP connector to retrieve Salesforce document data. It then writes that data out to a Lingk hosted local file in a base 64 Encoded JSON file.
Salesforce 'typeOf' usage for multi-reference fields
This recipe shows how to use the 'typeOf' SOQL statement in Salesforce. TYPEOF is an optional clause that can be used in a SELECT statement of a SOQL query when you’re querying data that contains polymorphic relationships. A TYPEOF expression specifies a set of fields to select that depend on the runtime type of the polymorphic reference.
SFTP Tasks
This recipe reads a file from SFTP processes the data and then overwrites the file with new data. To run this recipe configure an SFTP connector in your environment
Test environment variables
This recipe demonstrates how to update the environment variables from a static json.
Simple SFTP Reader/Writer
This recipe reads a CSV file from SFTP, display its contents on the screen, then writes the same contents to another file through SFTP. This recipe reads a CSV file from SFTP, display its contents on the screen, then writes the same contents to another file through SFTP. To use this recipe, 1. Configure an SFTP connector in your environment (use the SFTP setup guide on the right) 2. Create a file in the root of the SFTP folder named test.csv 3. Run the recipe
Ellucian Ethos to Salesforce EDA ( Terms )
This recipe pulls academic period, Term data, from Ellucian Ethos to load into Salesforce EDA Term Object.
Ellucian Ethos to Salesforce EDA (Reference Data)
This recipe retrieves Ellucian Ethos Reference Data and writes back to Salesforce #1. Pulls all reference data models from ethos eg:- course title types, email types, countries. #2. Insert reference info in ethos object matching with ethos id.
Ellucian Ethos to Saleforce EDA ( Student Academic Programs )
This recipe moves student academic history data from Ellucian Ethos to Salesforce EDA.
Ellucian Ethos to Salesforce EDA ( Academic History)
This recipe retrieves Ethos Academic History and writes back to Salesforce custom object (hed__Education_History__c)
Ellucian Ethos to Salesforce EDA ( Academic Programs)
This recipe pulls academic program data from Ellucian Ethos to Salesforce EDA. 1. Pulls academic programs from ethos. 2. Insert/Update academic programs in SF account object where record type = 'Academic Program'. 3. Set "University" account AS ParentId in Account object.
Ellucian Ethos to Salesforce EDA ( Courses )
Load Courses from Ellucian Ethos to Salesforce EDA. 1. Pulls all courses from ethos. 2. Insert/Update courses info into SF matching with external guid. 3. Set "College / University" account AS hed__Account__c in course object.
Ellucian Ethos to Salesforce EDA ( Instructional Events / Course Offerings)
This recipe retrieves Ellucian Ethos Instructional Events and writes back to Salesforce custom objects (hed__Course_Offering_Schedule__c & hed__Time_Block__c)
Ellucian Ethos to Salesforce EDA ( Person / Contact )
This recipe moves person data from Ellucian Ethos to Salesforce EDA ( Contact - ETHOS MODELS: 1. /persons 2. /addresses -RECIPE STEPS: 1. Pulls persons from ethos and transformed data. 2. Insert/update contact into SF matching with external guid (ethos id). 3. Pulls address from ethos by address id which is present in persons info. 4. Insert/update address into SF matching with external guid (ethos id).
Ellucian Ethos to Salesforce EDA ( Registration )
This recipe retrieves Ellucian Ethos Registration and writes back to Salesforce custom object (hed__Course_Enrollment__c)
Ellucian Ethos to Salesforce Eda ( Sections / Course Offerings )
This recipe moves section data from Ellucian Ethos to Salesforce EDA. - ETHOS MODELS: 1. /sections 2. /sites - RECIPE STEPS: 1. Select all terms from SF started in past 3 months. 2. Pulls sections from ethos filterd by term. 3. Get site id from sections and pulls sites from ethos. 4. Insert/Update site into SF facility object matching with external guid. 5. Insert/Update sections into SF course offering object matching with external guid.
Upsert Records with the Salesforce Bulk Writer
Upserts allow you to Insert or Update new records based off of whether they exist or not via the use of a defined primary key. This recipe shows you how to build a recipe that is able to perform Upserts on a Salesforce instance.
On-Premise API Gateway and Salesforce
This recipe connects on-premise databases such as Oracle and MS SQL Server to Salesforce. Using this recipe, you can pull data from ERPs like Ellucian Colleague, Ellucian Banner, Anthology Student, Oracle Campus Solutions, and more! After configuring the on-premise gateway and the environment with Salesforce, click Run.
LeadSquared API Reader - Opportunity Details
This recipe reads details for an opportunity. Replace the "path" property with the desired LeadSquared API endpoint. Use parameterizedBy to loop over a set of values from a datatable. Configure LeadSquared credentials in your Environment before running this recipe.
LeadSquared API Writer - Leads
This recipe writes a sample Lead to a LeadSquared account. Configure LeadSquared credentials in your Environment before running this recipe.
Map and Merge Delimited Strings (Salesforce Mulitselect Picklists, etc.)
This recipe demonstrates how to map and merge comma delimited values across systems. Salesforce picklist values are a good example as they are a semi-colon (;) delimited string and many times the input is a comma (,) delimited string. The Lingk platform has functions like transform() that simplify these data processing scenarios.
Element451 Reader
This recipe reads data from an Element451 data source. To use this recipe, insert the required Element451 source credentials and click Run!
Element451 Writer
This recipe inserts a json source data object into an Element 451 based end point. To use this recipe, click Run!
DocuSign Reader
This recipe reads data from docusign status changes based on a filter. To execute, set a templateId variable in the Environment variables.
Normalize Unicode characters to ASCII characters
This recipe converts demonstrates normalizing Unicode text to ASCII values for systems that do not support Unicode characters. To use this recipe, click Run!
Schema Techniques for Null Nested Data Properties
This recipe demonstrates how to ensure a recipe complete when nested data structures are used with inline() or explode() functions. The key is to attach a schema to the connector that defined the temporarily non-existant value that Spark will otherwise drop the column for (because it's all null) Note: we are looking for an endOn date that doesn't exist in this payload but could. Use schema to ensure that the field is available even if null.
Cross Join of Two Tables
This recipe executes a Cross JOIN between two tables. Warning: cross joins can be very slow and should only be used when absolutely necessary. To run this recipe, click the Run button.
XML to JSON Conversion Microservice Helper Example
This recipe converts some static XML to an JSON for processing. The XML to JSON help service can handle up to 50 MB XML files To use this recipe, click Run!
Email Microservice Helper Example
This recipe sends text-based notification emails. While you can send multiple notifications at once, this recipe is NOT designed for marketing purposes. Please contact Lingk support for marketing solutions. To use this recipe, click Run!
XML to JSON Helper Service
This recipe converts some static XML to an JSON for processing. https://xmltojson.lingkcloud.com/api/v1/xmltojson can only be called from the recipe. The XML to JSON help service can handle up to 50 MB XML files To use this recipe, click Run!
Salesforce Upsert Example supporting Lookups
This recipe demonstrates upserting to multiple Salesforce objects with lookup relationships. To run this recipe, change the source and targets. Update the statements to match your SF data sets and click "Run". The process is as follows: 1. Read data from the source and target 2. Transform the source data 3. Make the insert and update data sets 4. Refresh the source data before creating child objects to get the SF object IDs for newly created SF objects
Using Lookup Values in Select Statements
This recipe uses a file as a lookup table for values in a specific field. To use this recipe, upload the file into the Local File connector for your Environment.
Fixed Width Data Processing
This recipe reads data from a fixed width file with line breaks between records. Use substring and trim functions to pull out specific column values.
Escape Unicode characters for JSON, XML and more...
This recipe encodes Unicode characters to JSON compatible strings. To use this recipe, click Run!
Amazon S3 Lambda File Trigger to Ethos Person Import
This recipe processing a file on S3 from a Lamdba file upload trigger and importing the data into the Ethos persons APIs. To use this recipe: 1. edit the Lambda function, 2. import it into AWS 3. associated it with an S3 bucket. 4. Ethos creds: Set up the Ethos connector environment AND upload a seperate credential file for use by the HTTP connector Download and edit the accompanying Lamdba function: https://s3.amazonaws.com/lingk-videos/lambda-examples/LambdaFunctionForS3ToLingkEvent.zip
Aeries Sections and Programs SIS Reader to Salesforce
This recipe reads sections and program data from the Aires SIS (K-12). You need the Aeries-Cert for the API calls. You can use the demo cert from their documentation. While the credentials are inline, you can upload a config file to the environment and read the values from config to enable the recipe to be portable across environments. To use this with a Salesforce connector, add a SF connector to an environment, uncomment the SF, and run this recipe under the environment.
Retrieve Leads from the Marketo REST API
This recipe retrieves the AuthToken from Marketo and uses it in a subsequent API request. To run this recipe, replace all tenant and API configurations with your configuration and click "Run".
Transforming and Writing Bulk Data in Batches
This recipe batches and transforms data for enables batched output to API or file-based data writers. To use this recipe, click Run!
Amazon RDS (PostgreSQL) to Google Spreadsheet Writer
This recipe enables you to read data from a postgres database and write the data to a Google spreadsheet. To get started with this recipe, configure the AWS RDS and Google Spreadsheet connector in environments. Then, select your environment and click "Go".
Blackboard Learn REST API Courses to SFTP file
This recipe reads all the courses from a Blackboard Learn instance through the Blackboard REST API and writes them to a file on an SFTP site. Paging of data and security is automatically handled. To run this recipe, configure the Blackboard and SFTP connector in your environment, select your environment, and click "Run".
Blackboard Learn REST API Course Reader
This recipe reads all the courses from a Blackboard Learn instance through the Blackboard REST API. Paging of data and security is automatically handled. To run this recipe, configure the Blackboard connector in your environment, select your environment, and click "Run".
Blackboard Users to Salesforce Contacts Writer
This recipe reads all the Blackboard Learn users and upserts them as contacts to Salesforce. This pattern can be extended to any Blackboard endpoint or Salesforce object. Lingk handles all the details of the integration, you just worry about the data. To get started: (a) Add a Blackboard connector and (b) add a Salesforce connector to an environment. Select the environment and run. Note: You can comment out the INSERT and UPDATE statements for a "safe" run.
Creating and Updating Objects with the Salesforce REST API Writer
This recipe demonstrates creating and updating data with the Salesforce REST API. The recipe will create an account, retrieve it's ID and then use the ID to update the name of the same account. To run this recipe, configure a Salesforce connector in your environment and click "Run".
Dynamically Building JSON and XML Arrays Using Template Expressions
This recipe dynamically populates values into an JSON or XML payload to demonstrate using Jinja templates to build arrays and XML elements. To run this recipe, click the "Run" and "Start Recipe" buttons.
Multi-step REST Auth Flow Example (OAuth, etc)
This recipe makes a request for an authentication token, inserts the value into Execution Content and uses the token for subsequent request. To run this recipe, add the headers for the first step of your
Snowflake - Read Tables and Write CSV Data
This recipe reads and writes data to the Snowflake data warehouse. To use this recipe, add environment variables for the related Snowflake properties. Then click "Run"!
Fuzzy Matching with Soundex and Levenshtein
This recipe demonstrates the use of fuzzy matching in Spark with Soundex and Levenshtein Distance. The soundex algorithm is often used to compare first names that are spelled differently. You might want to use the Levenshtein distance when joining two DataFrames if you don’t want to require exact string matches. It’s always a struggle to minimize the number of false positives when performing fuzzy joins. So do multiple tests and join with multiple columns to improve results. To run this recipe, choose your environment and click Run!
Using SQL to create complex JSON structures
This recipe demonstrates creating a number types of JSON structures. To run this recipe, choose your Environment, and click "Run". For more examples, go to: https://docs.databricks.com/spark/latest/spark-sql/complex-types.html
Using Jinja-like Template Expressions in Connectors and Statements
This recipe demonstrates using Jinja-style templates and the variable collections available at different stages of a recipe execution. To use this recipe, click Run!
Create New Users in Canvas
This recipe creates Canvas users based on a data source. It will not update users, only create new ones. To run this recipe, set up the Canvas connector in your environment, choose your Environment, and click "Run".
Inserting JSON into Amazon S3
This recipe demonstrates output different JSON structures to Amazon S3. To use this recipe, just click "Run"
Simple Lingk Event API Subscription Tester
This recipe demonstrates a Mock event payload for recipe subscription. To use this recipe -- select your environment, run the recipe, and paste the sample event payload into the Event window.
Trigger Lingk Events through a Recipe
This recipe writes an event payload to a Lingk event (through the REST API) that can trigger other recipes or publish the data to webhooks for Zapier and other apps. To use this recipe, create an object in the Lingk app under Events, subscribe it to a recipe or webhook, update the object name in the recipe, and click Run!
Date formatting with Spark and Jinja
This recipe demonstrates using Spark and Jinja (Jinjava) expressions. To run this recipe, click the "Run" and "Start Recipe" buttons.
Salesforce EDA to Canvas Course Writer
This recipe reads data from a Salesforce Education Data Architecture (EDA) course object and writes to a Canvas course. To run this recipe, configure the Salesforce and Canvas connectors in your environment. Then click "Run" and "Start Recipe".
JSON API to SOAP APIs and SOAP XML processing
This recipe dynamically populates values into an SOAP XML payload, submits the request and processes the result. Jinja templates can be used to dynamically build the XML elements based on data from another connector (i.e. API request). Credentials can be stored in a CSV in the local file connector and to dynamically populate credentials and make the recipe safe across environments. To use this recipe, click Run!
Salesforce Org to Org Migration with Record Types
This recipe interacts with two orgs with different data models and record types. To use this recipe, Add one org to the environment and add the second org to the inline credentials.
Date Formatting Examples
This recipe parses some static dates and shows how to convert them into other formats. To use this recipe, click Run!
Automatic Union of Multiple JSON files
This recipe dynamically unions two or more like JSON files on Amazon S3 together into a single dataset for transformation and aggregration. To use this recipe, configure the S3 connector in your environment and upload the file into your Amazon S3 bucket. Then download the file from Local File area for your environment and "Run"
Print the Schema of a Connector or Table
This recipe convert data from a connector to a schema. Schemas are important because they enable you to use NULL columns in a queries without errors.
Join JSON and database data to output an Excel Spreadsheet
This recipe joins JSON and postgres Database data together to create an Excel spreadsheet. To run this recipe, upload rows_100k.json1 to your Local File connection and configure the Amazon RDS connector. Update the SQL statements, click run. This recipe joins JSON and postgres Database data together to create an Excel spreadsheet. To run this recipe, upload rows_100k.json1 to your Local File connection and configure the Amazon RDS connector. Update the SQL statements, click run.
Lingk Event APIs to Google PubSub Events
This recipe writes a JSON array to multiple messages on a Google PubSub topic. To use this recipe, configure Google PubSub in your environment, set your PubSub topic, select your environment, and run the recipe.
Join Salesforce data for better Excel reporting or CSV data feeds
This recipe joins Salesforce data for a better excel reporting or csv data feeds. To use this recipe, connect to Salesforce in your environment, update the salesforceReaders connectors and click run.
Data diff deltas on full datasets to event driven webhook subscriptions
This recipe does a data diff on JSON structures in the JSON connector (though it will work with ANY connector because all outputs are the same for Lingk). To use this recipe, just click Run! To see changes, delete, change, and add records and run again to see the output. Lingk stores a hashed version of the records and their keys in a storage bucket.
Excel to Postgres (Amazon RDS) Writer
This recipe reads data from an Excel spreadsheet and writes to a Postgres database on Amazon RDS. To run this recipe, configure an environment with a Local File (upload an Excel doc) and the Amazon RDS connector.
Aggregate and append to large public data sources to Excel file
To use this recipe, upload the Chicago crimes file from data.gov into the Local File connector for your Environment. For more information on the calculations here, see: https://blog.godatadriven.com/impala-haversine.html
Salesforce Recipe with Multiple Orgs
This recipe demonstrates use credentials from the environment for one organization and adding inline credentials for the second organization. This example demonstrates Salesforce reader connectors, but the same approach will work with Salesforce writers as well.
Lingk Adapter to Moodle User Sync
This recipe reads users data from the Lingk Adapter (powered by Apache Nifi) and upserts student records into Moodle using the Lingk Moodle Connect plugin (a REST service layer for Moodle) To use this recipe: 1. Install Apache Nifi on a server, add Lingk Adapter extensions, and configure 2. Install Moodle Connect plugin on your Moodle instance (see Lingk for access to plugin) 3. Configure Lingk Adapter and Moodle in your Lingk environment. 4. Run / Schedule recipe
Salesforce to Colleague by Ellucian (Lingk Adapter - Unidata)
This recipe interacts with two orgs with different data models and record type Ids. TO RUN: 1. Create a free Salesforce Dev account 2. Connect Salesforce account to Lingk environment 3. Add a custom Picklist field named "Verification Status" to the Contact record 4. Set a contact to have a "NotVerified" value for this field.
CSV to JSON File Conversion
This recipe does a data diff on JSON structures in the JSON connector (though it will work with ANY connector because all outputs are the same for Lingk) To use this recipe, just click Run! To see changes, delete, change, and add records and run again to see the output. Lingk stores a hashed version of the records and their keys in a storage bucket.
CSV to Excel File Conversion
This recipe converts an CSV file to Excel. To use this recipe, upload the file into the Local File connector for your Environment.
CSV File Reader
To use this recipe, upload the file into the Local File connector for your Environment.
Excel to CSV File Conversion
This recipe converts an Excel file to CSV. To use this recipe, upload the file into the Local File connector for your Environment.
JSON (S3 hosted) to Excel File Conversion
This recipe converts JSON (nested or flat) to an Excel file. To use this recipe, configure the Amazon S3 connector in your environment and upload the file into your S3 bucket. Then download the file from Local File area for your environment.
Union Multiple Excel Worksheets
This recipe unions the data form multiple worksheets into a single in-memory database to query. To use this recipe, upload the file into the Local File connector for your Environment.
Join Multiple Excel Spreadsheets and Output Excel
This recipe joins and aggregates multiple Excel worksheets / spreadsheets and ouput a single Excel spreadsheet. To use this recipe, upload the file(s) into the Local File connector for your Environment
Excel to JSON Conversion
This recipe converts an Excel file to JSON. To use this recipe, upload the file into the Local File connector for your Environment
Public Location Data Set Browser with Distance Calculation
This recipe will filter public crime data and output distance from downtown Chicago (lat/lon). To use this recipe, upload the Chicago crimes file from data.gov into the Local File connector for your Environment
Upsert Excel Data to Salesforce Contacts
This recipe will upsert one record from an Excel document into a Salesforce Contact object. To use this recipe, upload the file into the Local File connector for your Environment and connect a Salesforce instance.
Convert Nested Array to Table
This recipe demonstrates two ways to access nested array data using LingkQL using Spark SQL functions To run this recipe, click "run"
Canvas Users to Salesforce Contacts Writer
This recipe retrieves Camvas Users and writes back to Salesforce Contacts. This pattern can be extended to any Canvas endpoint or Salesforce object. Lingk handles all the details of the integration, you just worry about the data. To get started: (a) Add a Canvas connector and (b) add a Salesforce connector to an environment. Select the environment and run. Note: You can comment out the INSERT and UPDATE statements for a "safe" run.
Google PubSub Writer
Writes a JSON array to multiple messages on a Google PubSub topic.
Microsoft Dynamics CRM to SFTP
To use this recipe, enter your Dynamics crendentials inline in the recipe and and configure an SFTP connector in your environment.
Salesforce to Ellucian Ethos Writer
Pulls academic programs from Salesforce Education Data Architecture (EDA) Account objects and upserts them into the Ellucian Ethos Academic Levels object. To run, update the Salesforce SOQL query to point to your academic levels.
Ellucian Ethos to Salesforce Writer
This recipe pulls programs from Ellucian Ethos and upserts them into the Salesforce Education Data Architecture (EDA) Academic Program Account object.
Canvas REST API Reader - Retrieve Last Modules in Courses
This recipe retrieves the last module in each course using Spark SQL windowing. With this data you can retrieve all course completion data for any enrollment.
Canvas REST API Reader - Courses and Enrollments
Read courses and enrollments from the Canvas REST API.
Canvas REST API Writer
This recipe demonstrates creating an account_notification using the Canvas REST API. This example can be extended for any Canvas JSON pattern. The JSON can be dynamically built using struct() and named_struct() functions.
Lingk Adapter Reader (for Peoplesoft, on-prem DBs, etc.)
This recipe enables you to read data from on-premise databases (like Peoplesoft, Banner by Ellucian, Colleague by Ellucian, Oracle, MS-SQL, Postgres, and more). To use this recipe, install and configure the Lingk Adapter and configure the connector in your environment
Ellucian Ethos Writer
Write a payload to the Ellucian Ethos APIs.
Data Diff Simplified
Data diff on JSON structures in the JSON connector. However, it will work with ANY connector because all outputs are the same for Lingk!
Caliper Event Data Processor
This recipe uses a static JSON Caliper event with nested JSON-LD and represents how easy it is to flatten the data for additional processing. This recipe can be converted to a Streaming recipe by changing the type of the connectors. To get started, just run the recipe. No additonal configuration is required.
SFTP to Moodle (Upsert users)
This recipe will read a file from SFTP, transform the data and upsert the values into Moodle courses using the Lingk Connect Moodle plugin REST APIs. To get started, configure Moodle and SFTP connectors in your environment before running
Salesforce Power Reader (a better Workbench)
his recipe demonstrates how you can use SOQL to query any object in Salesforce, transform the data and write it back to Salesforce or SFTP. To use this recipe, configure an SFTP and Salesforce connector in your environment.
SFTP to Salesforce
Read a CSV file from SFTP, transform the data, and write the data to Salesforce using the bulk API.
SFTP to Microsoft Dynamics 365 CRM
This recipe reads data from SFTP and writes to MS Dynamics 365 oData APIs. To use this recipe, enter your Dynamics crendentials inline in the recipe and and configure an SFTP connector in your environment
Join data between two Google Spreadsheets
This recipe enables you to read data from multiple Google spreadsheets and join them with SQL To get started with this recipe, configure a Google Spreadsheet connector in environments. Then create two spreadsheets and share them wtih the same Google service account.
SFTP File Management
This recipe reads a file from SFTP processes the data and then overwrites the file with new data
Salesforce Data Cleanup
This recipe represents an easy to delete data immediately after a SOQL query
Ellucian Ethos to SFTP
This recipe joins Ellucian Ethos data into flattened table and writes to SFTP as CSV
Ellucian Ethos Join
Join Ellucian Ethos APIs and create a flattened table
Ellucian Ethos Reader
This recipe does not write any data is used to demonstrate simple Ellucian Ethos data reader
Nested Object Schemas
Process data with nested objects easily by applying a schema to connectors. Schemas are necessary for selecting *Null* columns in staged, in-memory tables.
Transformation Examples
This recipe demonstrates how to transform data from static JSONs using different spark functions to accomplish it