India • kolkata

Data Engineer (Immediate Joiner >30days)

Job Overview

Python Development,strong PHP or Javascript background

We’re on a bit of a mission at OnProcess. We are helping the world’s service supply chains get a whole lot better. Why? Because we believe that great customer service is a necessity, digital innovation is a game-changer and a new approach towards the ‘circular’ supply chain will drive dramatic sustainability benefits to the world – and we are making all this happen.

OnProcess are market leaders in the provision of innovative, engaging and value driven parts supply chain solutions across a diverse range of sectors. Solutions provided by OnProcess span Service Parts Planning, Delivery and Recovery services and comprise multiple technical and non-technical components.

The Data Engineer I will be part of a team responsible for designing, building, optimizing, and maintaining our data and data pipeline architecture. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer I will be responsible to ensure data consistency, integrity and traceability while maintaining the highest level of data protection and security. The Data Engineer I must be comfortable supporting multiple teams, systems, and projects.

Responsibilities and Duties

  • Analyze and organize raw data from multiple sources
  • Design, build or implement data pipelines along with supporting infrastructure
  • Create data processing architectures supporting the entire data lifecycle
  • Assemble large, complex datasets that meet functional and non-functional business requirements
  • Prepare data for prescriptive and predictive modeling
  • Conduct complex data analysis and report on results
  • Build algorithms and prototypes
  • Build automations and repeatable patterns to improve data processing efficiency
  • Support maintenance of existing data pipelines and architectures with a view to optimization
  • Identify opportunities for data acquisition
  • Understand business needs and objectives
  • Maintain strict data security controls and standards
  • Collaborate with data scientists and analytics teams
  • Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.
  • Adhere to data management best practices and maintain detailed documentation


  • Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
  • Strong analytic skills related to working with raw, structured, and unstructured datasets.
  • Experience supporting data transformation, data structures, metadata, and dependency management.
  • A successful history of manipulating, processing, and extracting value from datasets.
  • Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
  • 3+ years in data engineering experience
  • Relevant Bachelor’s degree, or equivalent combination of education and experience
  • Able to rapidly adapt and respond to changes in environment and priorities
  • Passionate about solving real problems
  • Self-assured and results oriented professional with an ownership mentality
  • Excellent written, verbal, and interpersonal communication skills both virtually and in person
  • Able to manage and support numerous complex projects simultaneously
  • Experience working with geographically disperse teams
  • Experience with ETL, ELT tools and workflows
  • Experience with scripting in a data engineering context (Python experience a plus)
  • Experience with common database technologies including SQL, NoSQL, Parquet
  • Experience with cloud-based database and data pipeline technologies (Azure experience a plus)
  • Experience with version control and dev ops pipelines

Physical Requirements

  1. Must be able to move intermittently throughout the workday
  2. Must possess sight/hearing/speech senses, or use prosthetics that will enable these senses to function adequately so that the requirements of this position can be fully met
  3. Quiet and limited distraction work from home environment



OnProcess Technology is an Equal Opportunity Employer and provides fair and equal employment opportunity to all employees and applicants regardless of race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other protected status prohibited under Federal, State, or local laws.