Lead/Senior Data Engineer

3 weeks ago

Hyderabad, India DATAECONOMY Full time

About Us
About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership.

Job Description
We are seeking a highly experienced and hands-on
Lead/
Senior Data Engineer
to architect, develop, and optimize data solutions in a cloud-native environment. The ideal candidate will have
7–12 years
of strong technical expertise in
AWS Glue, PySpark, and Python
, along with experience designing robust data pipelines and frameworks for large-scale enterprise systems. Prior exposure to the
financial domain
or regulated environments is a strong advantage.

Key Responsibilities

  • Solution Architecture: Design scalable and secure data pipelines using AWS Glue, PySpark, and related AWS services (EMR, S3, Lambda, etc.)
  • Leadership & Mentorship: Guide junior engineers, conduct code reviews, and enforce best practices in development and deployment.
  • ETL Development: Lead the design and implementation of end-to-end ETL processes for structured and semi-structured data.
  • Framework Building: Develop and evolve data frameworks, reusable components, and automation tools to improve engineering productivity.
  • Performance Optimization: Optimize large-scale data workflows for performance, cost, and reliability.
  • Data Governance: Implement data quality, lineage, and governance strategies in compliance with enterprise standards.
  • Collaboration: Work closely with product, analytics, compliance, and DevOps teams to deliver high-quality solutions aligned with business goals.
  • CI/CD Automation: Set up and manage continuous integration and deployment pipelines using AWS CodePipeline, Jenkins, or GitLab.
  • Documentation & Presentations: Prepare technical documentation and present architectural solutions to stakeholders across levels.

Requirements
Required Qualifications:

  • 7–12 years of experience in data engineering or related fields.
  • Strong expertise in Python programming with a focus on data processing.
  • Extensive experience with AWS Glue (both Glue Jobs and Glue Studio/Notebooks).
  • Deep hands-on experience with PySpark for distributed data processing.
  • Solid AWS knowledge: EMR, S3, Lambda, IAM, Athena, CloudWatch, Redshift, etc.
  • Proven experience in architecture and managing complex ETL workflows.
  • Proficiency with Apache Airflow or similar orchestration tools.
  • Hands-on experience with CI/CD pipelines and DevOps best practices.
  • Familiarity with data quality, data lineage, and metadata management.
  • Strong experience working in agile/scrum teams.
  • Excellent communication and stakeholder engagement skills.

Preferred/Good To Have

  • Experience in financial services, capital markets, or compliance systems.
  • Knowledge of data modeling, data lakes, and data warehouse architecture.
  • Familiarity with SQL (Athena/Presto/Redshift Spectrum).
  • Exposure to ML pipeline integration or event-driven architecture is a plus.

Benefits

  • Flexible work culture and remote options
  • Opportunity to lead cutting-edge cloud data engineering projects
  • Skill-building in large-scale, regulated environments.

  • Lead/Senior Data Engineer

    3 weeks ago

    Hyderabad, India Data Economy Full time

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Lead/Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time ₹ 20,00,000 - ₹ 35,00,000 per year

    We are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...

  • Lead Cloud Data Engineer

    3 weeks ago

    Hyderabad, India Data Economy Full time

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...

  • Lead Cloud Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Engage directly with clients to understand requirements, provide solution design, and drive successful project delivery.Lead cloud migration initiatives, specifically moving on-premise applications and databases to AWS cloud platforms.Design, develop, and maintain scalable, reliable, and secure data applications in a cloud...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Data Engineer

    7 days ago

    Hyderabad, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%)  Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Aws Data Engineer

    3 weeks ago

    Hyderabad, India Data Economy Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions. Key...

  • Senior Data Engineer

    3 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Experience Required: 8+Years Mode of work: Remote Skills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025) Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Aws Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Data Economy Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled and experienced Senior Data Engineer to lead the end-to-end development of complex models for compliance and supervision. The ideal candidate will have deep expertise in cloud-based infrastructure, ETL pipeline development, and financial domains, with a strong focus on creating robust, scalable, and efficient solutions.Key...