Data Engineer

4 days ago

Delhi, India Pacific Data Integrators Full time
Job OverviewWe are seeking a skilled

Data Engineer

to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS SQL Server, SingleStore, Databricks, and related technologies. You will play a crucial role in the daily monitoring of data workflows, supporting data modeling efforts, and collaborating with cross-functional teams.

Key Responsibilities• Data Pipeline Development & Management: Design, implement, and optimize data pipelines that ensure smooth data movement between systems, leveraging tools like Python and SQL.• Database Management & Optimization: Work with databases such as MS SQL Server, SingleStore, and Databricks, ensuring high performance, reliability, and scalability of data storage and retrieval processes.• Job Monitoring & Status Tracking: Monitor and track the status of overnight jobs, including SQL Server Agent jobs and Python scripts, ensuring successful execution and timely resolution of any issues that arise.• Data Modeling: Work with data translators to understand business requirements and translate them into effective data models using DBT (Data Build Tool).• Version Control & Workflow Management: Utilize Git for version control and manage development workflows via Azure DevOps, ensuring smooth collaboration within the development team and maintaining code integrity.• Collaboration & Communication: Collaborate with data scientists, analysts, and other engineers to ensure the availability, accuracy, and quality of data. Participate in regular team meetings to discuss project progress and challenges.• Troubleshooting & Issue Resolution: Proactively identify and troubleshoot issues in data workflows, providing solutions to enhance efficiency and minimize downtime.

Required Skills and Experience• Proficient in SQL: Strong knowledge of SQL for querying, analyzing, and optimizing data in relational databases like MS SQL Server.• Proficient in Python: Expertise in Python for data extraction, transformation, and integration tasks, including automation of repetitive tasks such as job monitoring.• Database Expertise: Hands-on experience working with MS SQL Server, SingleStore, and Databricks. Ability to optimize database performance and work with large datasets efficiently.• DBT (Data Build Tool): Solid experience in designing and managing data models using DBT, with the ability to translate business requirements into structured, usable data models.• Data Pipeline Development: Experience building and maintaining data pipelines for efficient, scalable data movement across systems.• Version Control & Workflow Management: Experience using Git for version control and managing workflows through Azure DevOps.• Job Monitoring: Ability to monitor and manage scheduled jobs such as SQL Server Agent jobs and Python scripts, including troubleshooting and performance monitoring.• Problem-Solving: Strong analytical skills with the ability to troubleshoot issues in data systems and provide innovative solutions.

Preferred Qualifications• Experience with cloud-based data platforms like AWS, Azure, or GCP.• Familiarity with data warehousing concepts and ETL frameworks.• Knowledge of additional programming languages such as Scala or R is a plus.• Experience working in an Agile development environment.• Familiarity with data visualization tools (e.g., Power BI, Tableau) is a bonus.

Education and Experience• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field (or equivalent experience).• Minimum of 3 years of experience as a Data Engineer or in a similar data-focused role.• Must work in

EST hours .

  • Data Warehouse Engineer | Data Warehouse Engineer | delhi

    3 weeks ago

    delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Data Warehouse Engineer

    3 weeks ago

    Delhi, India Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.

  • Senior Data Integration Engineer

    3 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer | Senior Data Integration Engineer | delhi

    3 weeks ago

    delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Integration Engineer

    3 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...

  • Senior data integration engineer

    3 weeks ago

    Delhi, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Engineer

    5 days ago

    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • ITI Data | PySpark Data Engineer

    1 week ago

    delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • PySpark Data Engineer

    1 week ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • Pyspark data engineer

    1 week ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a Py Spark...

  • Lead data engineer

    1 month ago

    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Data Platform Engineer

    2 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data platform engineer

    2 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Data Platform Engineer

    2 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • AWS Data Engineer

    1 month ago

    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    2 months ago

    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    4 months ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    1 month ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • ITI Data | PySpark Data Engineer

    1 week ago

    Delhi, India ITI Data Full time

    Location:IndiaType: Full-timeExperience: 10 – 13 yearsFunctions: Consulting, Finance, Information Technology, Big Data EngineeringIndustries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions developer...

  • PySpark Data Engineer

    1 week ago

    Delhi, India ITI Data Full time

    Location:IndiaType: Full-timeExperience: 10 – 13 yearsFunctions: Consulting, Finance, Information Technology, Big Data EngineeringIndustries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions developer...