Lead/Senior Data Engineer

1 week ago

Hyderabad, Telangana, India DATAECONOMY Full time ₹ 12,00,000 - ₹ 36,00,000 per year

About Us
About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.

Job Description
We are seeking a highly experienced and hands-on
Lead/
Senior Data Engineer
to architect, develop, and optimize data solutions in a cloud-native environment. The ideal candidate will have
7–12 years
of strong technical expertise in
AWS Glue, PySpark, and Python
, along with experience designing robust data pipelines and frameworks for large-scale enterprise systems. Prior exposure to the
financial domain
or regulated environments is a strong advantage.

Key Responsibilities

  • Solution Architecture: Design scalable and secure data pipelines using AWS Glue, PySpark, and related AWS services (EMR, S3, Lambda, etc.)
  • Leadership & Mentorship: Guide junior engineers, conduct code reviews, and enforce best practices in development and deployment.
  • ETL Development: Lead the design and implementation of end-to-end ETL processes for structured and semi-structured data.
  • Framework Building: Develop and evolve data frameworks, reusable components, and automation tools to improve engineering productivity.
  • Performance Optimization: Optimize large-scale data workflows for performance, cost, and reliability.
  • Data Governance: Implement data quality, lineage, and governance strategies in compliance with enterprise standards.
  • Collaboration: Work closely with product, analytics, compliance, and DevOps teams to deliver high-quality solutions aligned with business goals.
  • CI/CD Automation: Set up and manage continuous integration and deployment pipelines using AWS CodePipeline, Jenkins, or GitLab.
  • Documentation & Presentations: Prepare technical documentation and present architectural solutions to stakeholders across levels.

Requirements
Required Qualifications:

  • 7–12 years of experience in data engineering or related fields.
  • Strong expertise in Python programming with a focus on data processing.
  • Extensive experience with AWS Glue (both Glue Jobs and Glue Studio/Notebooks).
  • Deep hands-on experience with PySpark for distributed data processing.
  • Solid AWS knowledge: EMR, S3, Lambda, IAM, Athena, CloudWatch, Redshift, etc.
  • Proven experience in architecture and managing complex ETL workflows.
  • Proficiency with Apache Airflow or similar orchestration tools.
  • Hands-on experience with CI/CD pipelines and DevOps best practices.
  • Familiarity with data quality, data lineage, and metadata management.
  • Strong experience working in agile/scrum teams.
  • Excellent communication and stakeholder engagement skills.

Preferred/Good To Have

  • Experience in financial services, capital markets, or compliance systems.
  • Knowledge of data modeling, data lakes, and data warehouse architecture.
  • Familiarity with SQL (Athena/Presto/Redshift Spectrum).
  • Exposure to ML pipeline integration or event-driven architecture is a plus.

Benefits

  • Flexible work culture and remote options
  • Opportunity to lead cutting-edge cloud data engineering projects
  • Skill-building in large-scale, regulated environments.

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior/Lead Data Engineer

    1 week ago

    Hyderabad, Telangana, India People Prime Worldwide Full time

    Senior Azure Data EngineerJob Details:Role: Senior Azure Data EngineerExperience: 7-10 YearsLocation: HyderabadInterview Mode: F2FNotice Period Preference: Immediate to 30 DaysJob Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Microsoft Azure data ecosystem to design, develop, and maintain scalable data pipelines...

  • Senior Data Analyst

    1 week ago

    Hyderabad, Telangana, India Data Unveil Full time

    Description : About us : Data Unveil is the next generation provider of best-in-class data aggregation services. Our solutions and methodologies have been honed over the past 10 years by experienced practitioners who have collectively supported 100+ brands, 100+ data partners and 25+ new drug launches. Our integrated capabilities create a...

  • Senior Data Manager/ Lead

    1 week ago

    Hyderabad, Telangana, India Codeforce 360 Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description:We are looking for a highly experienced and dynamic Senior Data Manager / Lead to oversee a team of Data Engineers and Data Scientists. This role demands a strong background in data platforms such as Snowflake and proficiency in Python, combined with excellent people management and project leadership skills. While hands-on experience in the...

  • Property Data Engineer

    1 week ago

    Hyderabad, Telangana, India ICE Data Services Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job PurposeThe Property Data Engineeris responsible for developing and maintaining data conversion programs that transform raw property assessment data into standardized formats based on specifications by Property Data Analyst and Senior Analysts. This role requires not only advanced programming and ETL skills but also a deep understanding of the structure,...

  • Senior Data Engineer

    1 day ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture, Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 29th 2025)Translate business rules into technical specifications and implement scalable data solutions.Manage a...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Lead Data Engineer

    7 days ago

    Hyderabad, Telangana, India EverestDX Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    Description : We are seeking a highly skilled Lead Data Engineer to design, build, and scale robust data platforms and pipelines that empower business decisions and analytics. This role combines deep technical expertise with strategic leadership, guiding a team of data engineers to deliver scalable, reliable, and high-performing data solutions. The ideal...

  • Senior Data Engineer/Architect

    6 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...