Senior Data Engineer – Etl

14 hours ago

Bhopal, India Whatjobs IN C2 Full time

Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 Years Location: Remote (Work from Home) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 2 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate Joiners Preferred What We Are Looking For: 7–12 years of hands-on experience in designing, developing, and deploying end-to-end data pipelines and ETL workflows — not just using prebuilt tools, but building from scratch using Python and SQL. Strong command of Python programming for data transformation, orchestration, and automation (e.G., using Pandas, Airflow, or custom schedulers). Solid experience in writing complex SQL queries , optimizing database performance, and designing schemas for large-scale systems. Proven experience integrating RESTful APIs for data ingestion, transformation, and delivery pipelines. Working knowledge of AWS / GCP / Azure for data storage, processing, and deployment (S3, EC2, Lambda, BigQuery, etc.). Practical exposure to Docker, Kubernetes , and CI/CD pipelines for automating and deploying ETL and data workloads. Familiarity with AI-driven data pipelines or automation workflows is an added advantage. Responsibilities: Design, architect, and build ETL pipelines from the ground up to extract, clean, transform, and load data across multiple systems. Develop and deploy custom Python-based data frameworks to automate workflows and improve data quality. Build and maintain high-performance SQL queries and database structures to support analytics and AI teams. Develop and integrate API-based data ingestion systems (internal and external). Deploy and manage workloads using Docker, Kubernetes, and CI/CD tools ensuring high availability and version control. Work closely with product, AI, and analytics teams to deliver intelligent, automated data solutions . Implement data validation, monitoring, and alerting mechanisms for production pipelines. Continuously optimize pipeline performance, cost efficiency, and scalability in cloud environments. Qualifications: Bachelor’s or Master’s degree in Computer Science, Engineering, or related field. Proficiency in Python (FastAPI, Flask, or Django) , SQL , and REST API design . Strong understanding of ETL principles, data modeling, and pipeline orchestration (Airflow / Prefect / Dagster). Experience working with AWS (S3, Lambda, EC2, Glue, Athena) or equivalent GCP/Azure components. Hands-on exposure to Docker, Kubernetes , and Git-based CI/CD workflows. Excellent problem-solving, debugging, and analytical skills with an ownership mindset .

  • Senior Data Integration Engineer

    2 weeks ago

    Bhopal, India Whatjobs IN C2 Full time

    Job Title - Senior Data Integration Engineer Experience - 6+Years Job Summary We are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intelligence ecosystem. In this critical role, you will be the subject matter expert responsible for designing and...

  • Data Engineer

    1 day ago

    Bhopal, India Philodesign Technologies Inc Full time

    Job Title:Data Engineer Experience:6–8 Years Work Mode:Remote (9 AM – 5 PM EST) Employment Type:Full-time Notice Period:Immediate JoinerAbout the Role We are seeking an experiencedData Engineerto design, develop, and implement robust data exchange and processing solutions using Azure technologies. The ideal candidate will have strong hands-on expertise...

  • Data Quality Engineer

    1 week ago

    Bhopal, Madhya Pradesh, India Ditstek Innovation Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 12,00,000 per year

    We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing and executing tests to ensure the quality and reliability of data...

  • Sr. Data Engineer

    1 day ago

    Bhopal, India xponent.ai Full time

    We are an Australian Data and AI company and are expanding ourDatabricks Capability in Indiaand are seeking aSenior Databricks Data Engineerto build scalable, production-grade data platforms that enable AI and advanced analytics for our global clients. We are open, transparent, no-nonsense, innovative problem solvers and eternal learners as a team where...

  • Senior Database Developer

    2 weeks ago

    Bhopal, Madhya Pradesh, India Katyayani Organics Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionKatyayani is a fast-growing, tech-driven agrochemical company with a diverse portfolio of over 250 lab-tested products. These products encompass the latest formulations in insecticides, fungicides, fertilizers, herbicides, and pest control, providing end-to-end farming solutions with just one click. Katyayani ensures that every product...

  • Senior Data Analyst

    2 weeks ago

    Bhopal, Madhya Pradesh, India Lumenore Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We're Hiring: Data AnalystWe are looking for aData Analystto join our team and help turn raw data into meaningful insights that drive smarter decisions.What You'll DoCollect, clean, and analyze large datasets from multiple sourcesDevelop dashboards, reports, and visualizations to track key metricsIdentify trends, patterns, and actionable insights to support...

  • Data Engineer

    3 weeks ago

    Bhopal, Madhya Pradesh, India Katyayani Organics Full time

    Position Data Engineer Location Bhopal Madhya Pradesh Experience Required 2-5 Years in Data Engineering Industry Chemical Manufacturing Website www katyayaniorganics com About Katyayani Organics At Katyayani Organics we are a rapidly growing leader in agro-inputs Established in 2016 we specialize in organic raw materials pesticides bio-pesticides and plant...

  • Pyspark Developer Intern

    2 weeks ago

    Bhopal, Madhya Pradesh, India SAA Consultancy Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Key ResponsibilitiesAssist in building PySpark ETL pipelines for structured/unstructured healthcare datasets.Support Delta Lake design ensuring schema evolution and compliance.Work with mentors on performance tuning and job orchestration.Document lineage, data quality checks, and compliance processes.Contribute to CI/CD setup and Git-based...

  • Azure data Brick Engineer

    1 day ago

    Bhopal, India Tata Consultancy Services Full time

    Role: Azure data brick EngineerExperience: 8+Location: Pan IndiaMust-Have 8+ years of hands-on experience in development. Azure – cloud technology – Function Apps,AWS, Python, PySpark , Databricks, Azure DevOps, Synapse, API. Strong knowledge Incident, problem, Change management, service management, service request. Must have hands on experience code...

  • Pyspark developer intern

    2 weeks ago

    Bhopal, Madhya Pradesh, India SAA Consultancy Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Key ResponsibilitiesAssist in building PySpark ETL pipelines for structured/unstructured healthcare datasets.Support Delta Lake design ensuring schema evolution and compliance.Work with mentors on performance tuning and job orchestration.Document lineage, data quality checks, and compliance processes.Contribute to CI/CD setup and Git-based...