Data Migration Framework

Framework & ETL Tools

Prorigo’s DMF (Data Migration Framework) can migrate data and files from any source system to target system. Framework uses ETL based tools to extract, transform, and load data and files. These tools have been built for most of the famous PLM systems, by just configuring the tools, data migration can be done with minimal effort. Framework supports adding new systems by just developing the plug-ins. Framework and tools have been tested with many customers and massive amounts of data.

Prorigo Data Migration Framework
  • Data migration can be done with minimal effort (cost effective) in constrained timelines.
  • Can handle massive amounts of data and files since migration is based on direct database to database.
  • Incremental(delta) extractions and loadings based on the date range.
  • Provides data validators at every step of the migration, issues can be detected early in the process.
  • Supports parallel extractions and loading for independent types data to save the time.
  • Provides detailed data and time metrics at every stage of the migration.
  • Readymade extractors and loaders available for many of the renowned PLM systems.
Data Extractor
  • With a single command, tool can extract object data and files related to a specific process area
  • Tool internally uses multiple parallel threads to extract data from database to expedite extraction process
  • Tool can extract incremental data based on a specific date and time
  • Tool can extract large datasets in the range of 100 million objects within a span of 8 hours
  • Tool is driven by config file that defines all types, relationships, formats (files) that should be extracted related to a specific process area
  • Tool doesn't use MQL, ADK or REST API, instead uses direct database queries to make extraction process optimal
  • Tool can extract object data, relationship data, files, and object history
  • As part of extraction process, tool provides diagnostics information that will give precise idea about current extraction status
Data Transformer

Transformers are the command line tools, that read flat files (extracted data from ENOVIA or third-party systems) and transform them to a form, suitable for loading the data to the target system. Here are couple of sample transformers implemented.

  • Thumbnail generation for CAD Models.
  • Viewable generation for CAD Models.
  • DerivedOutput generation for CAD Models.
  • SubComponent Rollup for CAD Models.
  • Classification transformation.
  • Splitting items from source system to multiple items and relationships.
  • Merging items and relationships from source system.
  • Generate excel files for child data that need not to be migrated.
Aras Data Loader
  • With a single command, tool can load object data and files related to a specific process area from a local folder
  • Tool internally uses multiple parallel threads to load data to expedite loading process
  • Tool can load incremental updates over already migrated data
  • Tool can load large datasets in the range of 100 million objects within a span of 10 hours
  • Tool is driven by config file that defines all types, relationships, formats(files) that should be loaded related to a specific process area
  • Tool doesn't use REST API, IOM or AML instead uses auto built SSIS packages to make loading process optimal
  • Tool can load object data, relationship data, files, and object history
  • As part of loading process, tool provides diagnostics information that will give precise idea about current loading status