Senior Python Data Engineer – ETL

1 day ago

Mangalore, India AIMLEAP Full time

Senior Python Data Engineer – ETL & Pipeline Development Experience: 5 to 12 Years Location: Remote (WFH) / Bangalore / India Mode of Engagement: Full-time No. of Positions: 5 Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / IT Industry: IT / Data / AI / LegalTech / Enterprise Solutions Notice Period: Immediate Joiners Preferred What We Are Looking For: - 5–12 years of hands-on experience building end-to-end ETL pipelines and data workflows from scratch (Python + SQL). - Strong expertise in Python for data transformation, automation, and orchestration (Pandas, Airflow, custom schedulers). - Ability to write complex SQL queries, optimize performance, and design scalable database schemas. - Experience integrating and consuming RESTful APIs for ingestion, transformation, and delivery pipelines. - Working knowledge of AWS / GCP / Azure (S3, Lambda, EC2, BigQuery, etc.). - Hands-on exposure to Docker, Kubernetes, and CI/CD for deploying ETL & data workloads. - Experience building or working with AI-driven / automated data pipelines (preferred). Responsibilities: - Design, architect, and build complete ETL pipelines for multi-system data extraction, cleaning, transformation, and loading. - Develop custom Python-based data automation frameworks to improve quality and speed. - Build and optimize SQL queries, tables, and database structures for analytics & AI use cases. - Create and manage API-based data ingestion / integration workflows. - Deploy and maintain workloads using Docker, Kubernetes, and CI/CD tools. - Collaborate with product, AI, and analytics teams to deliver intelligent data solutions. - Set up data validation, monitoring, logging, and alerting mechanisms for production pipelines. - Continuously optimize pipelines for performance, cost, scalability, and reliability. Qualifications: - Bachelor’s or Master’s degree in Computer Science / Engineering / IT. - Expertise in Python (FastAPI / Flask / Django), SQL, and REST API development. - Strong understanding of data modeling, ETL concepts, and pipeline orchestration (Airflow / Prefect / Dagster). - Experience with AWS (S3, Lambda, EC2, Glue, Athena) or GCP/Azure equivalents. - Hands-on experience with Docker, Kubernetes, and Git-based CI/CD workflows. - Strong debugging, problem-solving, and analytical capabilities with ownership mindset.

  • Data Engineer

    2 weeks ago

    Mangalore, India YO HR Consultancy Full time

    Data Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large...

  • Lead data engineer

    2 days ago

    Mangalore, India Prophecy Technologies Full time

    ???? We’re Hiring: LEAD DATA ENGINEER ???? Location: HYDERABAD(HYBRID) ???? ???? Experience: 7+ Years ⏳ Notice Period: Immediate to 30 Days Responsibilities Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse. Develop ETL/ELT workflows using Py Spark, Python, and Databricks notebooks. Implement and...

  • Senior Data Engineer/ Jr. Data Architect

    4 days ago

    Mangalore, Karnataka, India Niveus Solution Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Lead data engineering squad to design, build, and optimize ETL pipelines; ensures quality and performance standards.Must have one Hetero/Homogeneous migration experienceInteract closely with Business Analysis team, ETL team and BI Reporting teams to ensure understanding of proper use of data architecture.Design, build, and maintain physical databases,...

  • Aws data engineer

    2 days ago

    Mangalore, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!! TCS is looking for AWS data engineer Experience: 8-10 years Location: Kolkata, Hyderabad, Bangalore, Chennai, Pune, Gurgaon Required technical skill set: AWS Data & AI Must have skill sets: Strong hands-on experience with AWS Data Services: Amazon S3, Glue, Redshift, Athena, Kinesis, EMR. Expertise in AWS AI/ML...

  • Cloud Leader-Data Migration

    4 days ago

    Mangalore, Karnataka, India Niveus Solutions Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Description: Data Architect (Azure / GCP/ Databricks)About Us:Niveus Solutions is a dynamic and innovative organization dedicated to leveraging data to drive business growth and decision-making. We are seeking a highly skilled Senior Data Architect to join our team and play a pivotal role in designing, building, and maintaining robust data platforms on...

  • Senior Analyst-ETL/SQL

    4 days ago

    Mangalore, Karnataka, India Unify CX Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Experience:Minimum of 3 to 5 years in customer service industry in technical support area.Roles & Responsibilities:Provides application support with focus on ETL, SQL and data modeling Recognizes both basic and advanced problems, conducts research, provides resolutions, and follows up with customers as needed, escalating more complex cases to the appropriate...

  • Opening for Senior GCP Data Engineer @ Remote

    2 weeks ago

    Mangalore, India Quess IT Staffing Full time

    Hi,Exp: 8+ YearsEssential Skills:6+ years of professional experience in data engineering or a similar role.Hands-on experience with Google Cloud Platform (GCP) services (BigQuery, Cloud Run, Scheduler).Proficiency in SQL for data manipulation and analysis.Experience with dbt.Familiarity with infrastructure-as-code principles.Strong programming skills in...

  • Senior data analyst

    4 days ago

    Mangalore, India Beebom Full time

    Beebom is hiring a Senior Data Analyst for our in-house Tech team to work on our new product, Beebom’s Gadgets. In this role, you will own the analytics function end-to-end — from data exploration to driving measurable business impact. You’ll take ownership of analyzing data, understanding user behavior, and tracking product performance to guide...

  • Neo4j / Knowledge Graph Engineer

    3 days ago

    Mangalore, India PineQ Lab Technology Full time

    About the RoleLooking for an experienced Knowledge Graph / Neo4j engineer to design, implement and operate graph-based data platforms and integrations. The role involves graph data modelling, building ETL pipelines, and collaborating with data engineering and business teams.Technical Skills (Must-have)4–7+ years of experience in knowledge graphs, semantic...

  • Neo4j / Knowledge Graph Engineer

    3 days ago

    Mangalore, India PineQ Lab Technology Full time

    About the RoleLooking for an experienced Knowledge Graph / Neo4j engineer to design, implement and operate graph-based data platforms and integrations. The role involves graph data modelling, building ETL pipelines, and collaborating with data engineering and business teams.Technical Skills (Must-have)4–7+ years of experience in knowledge graphs, semantic...