Lead/Senior Data Engineer

2 days ago

Hyderabad, Telangana, India DATAECONOMY Full time ₹ 15,00,000 - ₹ 20,00,000 per year

About Us
About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.

Job Description
We are seeking a highly experienced and hands-on
Lead/
Senior Data Engineer
to architect, develop, and optimize data solutions in a cloud-native environment. The ideal candidate will have
7–12 years
of strong technical expertise in
AWS Glue, PySpark, and Python
, along with experience designing robust data pipelines and frameworks for large-scale enterprise systems. Prior exposure to the
financial domain
or regulated environments is a strong advantage.

Key Responsibilities

  • Solution Architecture: Design scalable and secure data pipelines using AWS Glue, PySpark, and related AWS services (EMR, S3, Lambda, etc.)
  • Leadership & Mentorship: Guide junior engineers, conduct code reviews, and enforce best practices in development and deployment.
  • ETL Development: Lead the design and implementation of end-to-end ETL processes for structured and semi-structured data.
  • Framework Building: Develop and evolve data frameworks, reusable components, and automation tools to improve engineering productivity.
  • Performance Optimization: Optimize large-scale data workflows for performance, cost, and reliability.
  • Data Governance: Implement data quality, lineage, and governance strategies in compliance with enterprise standards.
  • Collaboration: Work closely with product, analytics, compliance, and DevOps teams to deliver high-quality solutions aligned with business goals.
  • CI/CD Automation: Set up and manage continuous integration and deployment pipelines using AWS CodePipeline, Jenkins, or GitLab.
  • Documentation & Presentations: Prepare technical documentation and present architectural solutions to stakeholders across levels.

Requirements
Required Qualifications:

  • 7–12 years of experience in data engineering or related fields.
  • Strong expertise in Python programming with a focus on data processing.
  • Extensive experience with AWS Glue (both Glue Jobs and Glue Studio/Notebooks).
  • Deep hands-on experience with PySpark for distributed data processing.
  • Solid AWS knowledge: EMR, S3, Lambda, IAM, Athena, CloudWatch, Redshift, etc.
  • Proven experience in architecture and managing complex ETL workflows.
  • Proficiency with Apache Airflow or similar orchestration tools.
  • Hands-on experience with CI/CD pipelines and DevOps best practices.
  • Familiarity with data quality, data lineage, and metadata management.
  • Strong experience working in agile/scrum teams.
  • Excellent communication and stakeholder engagement skills.

Preferred/Good To Have

  • Experience in financial services, capital markets, or compliance systems.
  • Knowledge of data modeling, data lakes, and data warehouse architecture.
  • Familiarity with SQL (Athena/Presto/Redshift Spectrum).
  • Exposure to ML pipeline integration or event-driven architecture is a plus.

Benefits

  • Flexible work culture and remote options
  • Opportunity to lead cutting-edge cloud data engineering projects
  • Skill-building in large-scale, regulated environments.

  • Lead/Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Lead Cloud Data Engineer

    2 days ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,20,000 - US$ 2,00,000 per year

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Data Engineer Senior Consultant

    5 days ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:330296NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).- Understand...

  • Digital Engineering Lead Engineer

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 253253 NTT DATA Services strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad Telangana IN-TG India IN -Sr Syniti ADM...

  • Aws Data Engineer

    2 days ago

    Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and Databricks. Gather and analyse data requirements from business stakeholders and identify opportunities for data-driven insights. Build and optimize data pipelines for data ingestion, processing, and integration using Spark and Databricks. Ensure data...

  • Senior Data Engineer

    2 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Digital Engineering Lead Engineer

    5 days ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:320596NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Lead Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Cideon...

  • Lead/Sr. ETL Data Engineer

    2 days ago

    Hyderabad, Telangana, India Data Economy Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a skilled ETL Data Engineer to design, build, and maintain efficient and reliable ETL pipelines, ensuring seamless data integration, transformation, and delivery to support business intelligence and analytics. The ideal candidate should have hands-on experience with ETL tools like Talend, strong database knowledge, and familiarity with AWS...