Data Engineer

3 weeks ago

Delhi, India Pacific Data Integrators Full time
Job Overview
We are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS SQL Server, SingleStore, Databricks, and related technologies. You will play a crucial role in the daily monitoring of data workflows, supporting data modeling efforts, and collaborating with cross-functional teams.
Key Responsibilities
• Data Pipeline Development & Management: Design, implement, and optimize data pipelines that ensure smooth data movement between systems, leveraging tools like Python and SQL.
• Database Management & Optimization: Work with databases such as MS SQL Server, SingleStore, and Databricks, ensuring high performance, reliability, and scalability of data storage and retrieval processes.
• Job Monitoring & Status Tracking: Monitor and track the status of overnight jobs, including SQL Server Agent jobs and Python scripts, ensuring successful execution and timely resolution of any issues that arise.
• Data Modeling: Work with data translators to understand business requirements and translate them into effective data models using DBT (Data Build Tool).
• Version Control & Workflow Management: Utilize Git for version control and manage development workflows via Azure DevOps, ensuring smooth collaboration within the development team and maintaining code integrity.
• Collaboration & Communication: Collaborate with data scientists, analysts, and other engineers to ensure the availability, accuracy, and quality of data. Participate in regular team meetings to discuss project progress and challenges.
• Troubleshooting & Issue Resolution: Proactively identify and troubleshoot issues in data workflows, providing solutions to enhance efficiency and minimize downtime.
Required Skills and Experience
• Proficient in SQL: Strong knowledge of SQL for querying, analyzing, and optimizing data in relational databases like MS SQL Server.
• Proficient in Python: Expertise in Python for data extraction, transformation, and integration tasks, including automation of repetitive tasks such as job monitoring.
• Database Expertise: Hands-on experience working with MS SQL Server, SingleStore, and Databricks. Ability to optimize database performance and work with large datasets efficiently.
• DBT (Data Build Tool): Solid experience in designing and managing data models using DBT, with the ability to translate business requirements into structured, usable data models.
• Data Pipeline Development: Experience building and maintaining data pipelines for efficient, scalable data movement across systems.
• Version Control & Workflow Management: Experience using Git for version control and managing workflows through Azure DevOps.
• Job Monitoring: Ability to monitor and manage scheduled jobs such as SQL Server Agent jobs and Python scripts, including troubleshooting and performance monitoring.
• Problem-Solving: Strong analytical skills with the ability to troubleshoot issues in data systems and provide innovative solutions.
Preferred Qualifications
• Experience with cloud-based data platforms like AWS, Azure, or GCP.
• Familiarity with data warehousing concepts and ETL frameworks.
• Knowledge of additional programming languages such as Scala or R is a plus.
• Experience working in an Agile development environment.
• Familiarity with data visualization tools (e.g., Power BI, Tableau) is a bonus.
Education and Experience
• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field (or equivalent experience).
• Minimum of 3 years of experience as a Data Engineer or in a similar data-focused role.
• Must work in EST hours .

  • Data Engineer

    3 weeks ago

    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilledData Engineerto join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS...

  • ITI Data | PySpark Data Engineer

    4 weeks ago

    delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • ITI Data | PySpark Data Engineer

    9 hours ago

    delhi, India ITI Data Full time

    Location : India Type : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • Pyspark data engineer

    4 weeks ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a Py Spark...

  • PySpark Data Engineer

    4 weeks ago

    Delhi, India ITI Data Full time

    Location : IndiaType : Full-timeExperience : 10 – 13 yearsFunctions : Consulting, Finance, Information Technology, Big Data EngineeringIndustries : Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark...

  • Data platform engineer

    1 month ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...

  • Data Platform Engineer

    4 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Pacific Data Integrators | Data Engineer

    1 week ago

    delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...

  • ITI Data | PySpark Data Engineer

    4 weeks ago

    Delhi, India ITI Data Full time

    Location:IndiaType: Full-timeExperience: 10 – 13 yearsFunctions: Consulting, Finance, Information Technology, Big Data EngineeringIndustries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions developer...

  • PySpark Data Engineer

    4 weeks ago

    Delhi, India ITI Data Full time

    Location:IndiaType: Full-timeExperience: 10 – 13 yearsFunctions: Consulting, Finance, Information Technology, Big Data EngineeringIndustries: Capital Markets, Investment Banking, Alternative Investments, Financial Services, Management Consulting, Information Technology and Services, HealthcareJob DescriptionWe are looking for a PySpark solutions developer...

  • OSD Data Services | Data Platform Engineer | india

    4 weeks ago

    Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Engineer

    3 weeks ago

    Delhi, Delhi, India Pacific Data Integrators Full time

    Pacific Data Integrators is seeking a highly skilled Data Engineer to join our team. This role involves designing and optimizing data pipelines, ensuring seamless movement of data across systems, and supporting data initiatives with strong technical expertise.

  • Data Unveil | Quality Assurance Engineer

    4 weeks ago

    delhi, India Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...

  • Data Unveil | Quality Assurance Engineer

    4 weeks ago

    Delhi, India Data Unveil Full time

    About us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...

  • Anicca Data Science Solutions | Software Engineer | india

    4 weeks ago

    Delhi, India Anicca Data Science Solutions Full time

    Job descriptionAnicca Data is seeking a motivated Software Engineer who is eager to tackle complex challenges and apply their skills to innovative solutions. This role will primarily focus on developing code to manage large-scale data and working with intricate data structures. The successful candidate will contribute to existing codebases or create...

  • Data Dynamics | Storage Solutions Architect

    4 weeks ago

    delhi, India Data Dynamics Full time

    Company Description Data Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democracy. Trusted by over 300 organizations, including 25% of the Fortune 20, Data Dynamics is committed to creating a transparent, unified, and empowered data ecosystem. The company's AI-powered self-service data management software...

  • Wavicle Data Solutions | Senior Data Scientist

    4 weeks ago

    delhi, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Crayon Data | AI Architect

    4 weeks ago

    Delhi, India Crayon Data Full time

    Role:AI ArchitectExp: 10 to 15 yrsLocation: Chennai(Hybrid)In non-cloud Large Language Model (LLM) deployments, the AI Architect serves as a strategic leader, driving the alignment of AI solutions with business objectives while addressing critical challenges like scalability, governance, and security. Their role ensures sustainable and impactful AI...

  • Data Science Lead

    4 weeks ago

    Delhi, Delhi, India Merit Data and Technology Full time

    Chief NLP Developer PositionWe are seeking a highly skilled and experienced Chief NLP Developer to lead our NLP team.The ideal candidate will have a strong background in machine learning (ML), deep learning (DL), and large language models (LLMs).NLP Team Leadership:Lead the NLP team and provide strategic direction for NLP-related projects.Collaborate with...

  • Electrical Design Manager for Data Centre Projects

    4 weeks ago

    Delhi, Delhi, India Colt Data Centre Services Full time

    Job Overview Colt Data Centre Services is seeking a skilled Electrical Design Manager to join our team. This role will involve leading the design process for data centre projects, working closely with project managers, engineers, and other stakeholders.About YouWe are looking for an experienced Electrical Engineer with strong leadership skills and a proven...