• Cite Icon5
  • https://doi.org/10.1145/3167132.3167300Copy DOI Icon

NewTL

  • Apr 9, 2018
  • Vidroha Debroy +2 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Large-scale ETL (Extract, Transform, Load) Software Systems are very complex to build, and even harder to maintain, due to the many moving pieces, and varying ownership and responsibilities, across multiple parties. While some research has been done in the area of ETL, it primarily focuses on techniques for optimization of expensive operations, and identifying common challenges; but sheds little light on how to build a reliable and robust system in practice. In this paper, we discuss NewTL, an ETL software system that was built completely in-house at Varidesk Inc., that allows for ETL on a very large scale. and has facilitated seamless integration between our 3rd Party Logistics Providers (3PLs) and our ERP (Enterprise Resource Planning) system. In doing so, we provide-technical insights on real-world concerns such as speed and scalability; transparency on our decision to build versus buy; and touch upon other aspects that would be relevant to any ETL system in practice. We also provide metrics/real data (collected both directly by us, as well as through telemetry from external monitoring), that demonstrate the quality of NewTL. We find this to be the first study of its kind on such a scale, that serves to help other practitioners, as well as stimulate further research into this highly important field.

Similar Papers
  • Conference Article
  • Citations7

Upgrade ERP from C/S to B/S based on Web service

  • Jan 01, 2005
  • Weihong Li +1
  • Conference Article
  • Citations3

Enterprise Resource Planning System Global and Malaysian Perspective

  • Jan 01, 2012
  • Ahmad Saleh Shatat +1
  • Research Article
  • Citations2

Enhancing financial reporting and management efficiency through enterprise resource planning (ERP) systems: A theoretical review for large-scale energy operations

  • Oct 23, 2024
  • International Journal of Management & Entrepreneurship Research
  • Tolulope Ogundipe +2
  • Research Article
  • Citations4

IMPACT OF ENTERPRISE RESOURCE PLANNING SYSTEMS ON THE ACCOUNTING INFORMATION RELEVANCE AND FIRM PERFORMANCE

  • Aug 30, 2018
  • Russian Journal of Agricultural and Socio-Economic Sciences
  • D.M.A.I Luciana +2
  • Research Article
  • Citations2

Do accounting benefits of ERP systems impact the satisfaction of end-users? From the perspective of accountants and internal auditors in Sri Lanka

  • Mar 01, 2022
  • Journal of Accounting and Management Information Systems
  • Dulshan Karunarathna +1
  • Book Chapter

ERP Selection

  • Jan 01, 2010
  • Angappa Gunasekaran +1
  • Research Article
  • Citations17

Technological Factors Relevant to Continuity on ERP for E-Business Platform: Integration, Modularity, and Flexibility

  • Dec 01, 2005
  • Journal of Internet Commerce
  • Douglas Turner +1
  • Research Article
  • Citations2

Tax Auditing in Enterprise Resource Planning (ERP) Systems: The Influence and Countermeasures

  • Aug 11, 2010
  • Advanced Materials Research
  • Zhi Gang Qin
  • Research Article
  • Citations13

The impact of integrating enterprise resource planning systems with business intelligence systems on decision-making performance: an empirical study of the semiconductor industry

  • Jan 01, 2010
  • International Journal of Technology, Policy and Management
  • Chung Kuang Hou +1
  • Conference Article
  • Citations10

ERP systems in higher education institutions: Review of the information systems and ERP modules

  • May 01, 2018
  • Blerta Abazi Chaushi +2
  • Research Article
  • Citations1

Impact of Erp Systems on Operational Efficiency at Amazon

  • Jun 12, 2025
  • INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT
  • Paras Goyal
  • Research Article
  • Citations2

Linguistic performance evaluation for an ERP system with link failures

  • Apr 03, 2014
  • Information Sciences
  • Shin-Guang Chen
  • Conference Article
  • Citations5

A domain-specific language for supporting event log extraction from ERP systems

  • May 01, 2018
  • Ana Pajic Simovic +2
  • PDF
  • Research Article
  • Citations4

A South African institution perspective of a framework for enterprise resource planning systems

  • Jan 25, 2023
  • SA Journal of Information Management
  • Tahani P Shimange +1
  • PDF
  • Research Article
  • Citations3

A South African institution perspective of a framework for enterprise resource planning systems

  • Nov 22, 2022
  • SA Journal of Information Management
  • Tahani P Shimange +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.