Data Pipeline Engineer

2 days ago

New Delhi, India Trigyn Technologies Full time

Job Description: 1. Designing and building data pipelines to collect, process, transform, and store data from various sources. This involves understanding the data flow, selecting the appropriate technologies, and creating scalable and efficient data processing workflows. 2. Ensure that the data pipeline architecture is reliable and produces high-quality data. This involves monitoring the data pipeline, identifying and resolving issues, and implementing data validation and testing mechanisms. 3. Work closely with data scientists, data analysts, software engineers, and other stakeholders to understand their data requirements and ensure that the data pipeline architecture meets their needs. 4. Optimizing the data pipeline architecture to ensure efficient and scalable data processing. This involves identifying bottlenecks, optimizing data processing workflows, and selecting appropriate technologies and tools. 5. Ensure security and privacy of data in the pipeline architecture. This involves implementing appropriate security measures, such as data encryption, access controls, and auditing. 6. Documentation of the data pipeline architecture, data processing workflows, and data sources. This involves creating technical documentation, data flow diagrams, and reports that communicate the performance and quality of the data pipeline to stakeholders. Qualification: A bachelor's in computer science, data science, software engineering, or a related field Experience: ? 5+ years of relevant experience in data engineering, software development, or data architecture, in a cloud-based environment. ? Technical skills in data engineering, software development, and data architecture. This includes experience with big data technologies. ? Proficiency in one or more programming languages such as Python, Java, or Scala, as well as experience with scripting languages like Bash or PowerShell. ? Data management skills, data modelling, data governance, and data security. Analytical skills and experience with data analysis, data profiling, and data quality assessment. ? Project management methodologies, such as Agile or Scrum, and be able to manage projects independently.

  • GCP Data Pipeline Engineer

    3 days ago

    New Delhi, India People Prime Worldwide Full time

    About Client :-Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is...

  • AI Engineer

    3 days ago

    New Delhi, India BeGig Full time

    Job Role- AI Engineer (Data Pipelines & RAG)Job Type- Full-timeWork Mode- Remote(6 days working)We are looking for a hands-on AI/Data Engineer (4–7 years) to build and scale data pipelines powering GenAI and agentic applications. You’ll architect data models, build ETL/ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup...

  • Pipeline Technical Director

    2 weeks ago

    New Delhi, India Yotta Data Services Private Limited Full time

    Yotta Data Services is looking for a Pipeline Technical Director (TD) / Pipeline Developer with strong Python skills and experience integrating tools across major DCC applications. The ideal candidate will play a key role in developing, maintaining, and optimizing our production pipeline — ensuring efficient workflows between departments and smooth...

  • Pipeline Technical Director

    2 weeks ago

    New Delhi, India Yotta Data Services Private Limited Full time

    Yotta Data Services is looking for a Pipeline Technical Director (TD) / Pipeline Developer with strong Python skills and experience integrating tools across major DCC applications. The ideal candidate will play a key role in developing, maintaining, and optimizing our production pipeline — ensuring efficient workflows between departments and smooth...

  • Pipeline Engineer

    2 weeks ago

    New Delhi, India NPCC Engineering Pvt. Limited Full time

    Greetings from NPCC Engineering Pvt. Limited, Mumbai (NEL) !!We are currently hiring for "PIPELINE ENGINEER" position for our Mumbai Office at KanjurmargPosition requirement is as follows:- Industry - Oil and Gas, Detailed Engineering Services, EPC - Experience required - 5 to 15 Years - Qualifications – B.E / B.Tech / M.E / MTechSkills/Competencies...

  • Data Engineer

    5 days ago

    New Delhi, India Flexton Inc. Full time

    Role: Data Engineer (Spark | SQL | Big Data Pipelines)Location:Bengaluru, India Experience Neeeded:Spark, SQL, Data Streaming/Batch Processing, HDFS, Kafka Streaming Note: We’re specifically looking for immediate joiners or candidates who are ready to start immediately or with a very short notice period. Must be Local to Bengalore and comfortable working...

  • GCP Data Pipeline Engineer

    3 days ago

    Delhi, India People Prime Worldwide Full time

    About Client :-Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations.The company is...

  • GCP Data Pipeline Engineer

    3 days ago

    Delhi, India People Prime Worldwide Full time

    About Client :- Our client is a French multinational information technology (IT) services and consulting company, headquartered in Paris, France. Founded in 1967, It has been a leader in business transformation for over 50 years, leveraging technology to address a wide range of business needs, from strategy and design to managing operations. The company is...

  • Backend and Data Pipeline Engineer

    4 weeks ago

    Delhi, India JRD Systems Full time

    Job Role: Backend and Data Pipeline Engineer - PythonLocation: RemoteJob Type : Fulltime** Only Immediate Joiners **Job Summary:The Team:We’re investing in technology to develop new products that help our customers drive their growth and transformation agenda. These include new data integration, advanced analytics, and modern applications that address new...

  • Ai engineer

    16 hours ago

    Delhi, India BeGig Full time

    Job Role- AI Engineer (Data Pipelines & RAG)Job Type- Full-timeWork Mode- Remote(6 days working)We are looking for a hands-on AI/Data Engineer (4–7 years) to build and scale data pipelines powering Gen AI and agentic applications. You’ll architect data models, build ETL/ELT workflows, and integrate pipelines with RAG-based systems in a fast-paced startup...