Data Engineer Manager

3 days ago


Kannur, Kerala, India SID Information Technologies Full time

1) Role: Data Engineering Manager | 12+ Years

Location: Hyderabad

  Experience: 12+ Years

  Apply Now: Kriti.singh@𝐬𝐢𝐝𝐢𝐧𝐟𝐨𝐫𝐦𝐚𝐭𝐢𝐨𝐧.𝐜𝐨𝐦

  Preferred: Immediate Joiners

  Domain Preference: Healthcare

Apply @: Kriti.singh@sidinformation.com

We are looking for a high-end Engineering Manager who can provide technical direction for a highly scalable data platform in clinical oncology or the healthcare domain, having a tech stack spanning AWS, Python, Terraform, and all the new buzz around AI. A blend of strong technical skills in areas like data architecture, ETL, cloud platforms, and big data technologies, alongside crucial soft skills such as leadership, communication, problem-solving, business acumen, and project management. The manager must oversee the design and maintenance of data systems, manage and mentor a team, and align technical solutions with business objectives.

Technical Skills

- Data Architecture & Modelling: Design and oversee scalable data models, warehouses, and lakes.

- Programming Languages: Proficiency in languages like Python, SQL, and Scala for data processing and pipeline development.

- Databases: Deep understanding of SQL, NoSQL (e.g., MongoDB), and relational databases (e.g., PostgreSQL).

- Cloud Platforms: Expertise in cloud environments such as AWS, Azure, or GCP.

- Big Data Technologies: Experience with tools like Spark, Kafka, Hadoop, and Snowflake.

- Data Governance & Security: Ensure data compliance, privacy, and security protocols are followed.

- CI/CD & Automation: Familiarity with DevOps practices for efficient deployment and management.

Primary Responsibilities:

  • Data Engineering Lifecycle: Lead research, proof of concept, architecture, development, testing, deployment, and ongoing maintenance of data solutions
  • Data Solutions: Design and implement modular, flexible, secure, and reliable data systems that scale with business needs
  • Instrumentation and Monitoring: Integrate pipeline observability to detect and resolve issues proactively
  • Troubleshooting and Optimization: Develop tools and processes to debug, optimize, and maintain production systems
  • Tech Debt Reduction: Identify and address legacy inefficiencies to improve performance and maintainability
  • Debugging and Troubleshooting: Quickly diagnose and resolve unknown issues across complex systems
  • Documentation and Governance: Maintain clear documentation of data models, transformations, and pipelines to ensure security and governance compliance
  • Cloud Expertise: Leverage advanced skills in AWS and EKS to build, deploy, and scale cloud-native data platforms
  • Team Leadership: Lead and mentor engineering teams to ensure operational efficiency and innovation Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

2) Role: Sr. Data Engineer

Location: Hyderabad (Hybrid)

6+ years of experience

- immediate joiner

- For a Healthcare Data Analytics Client

Hands-on skills required for this position:

Proficient with Python Programming, Scala, SQL, and Redshift

AWS ecosystem

Infrastructure as a code using Terraform

Experience leading and handling a team of Data Engineers

Short Description:

Technical Skills

- Strong programming skills in Python or Scala.

- Hands-on with SQL

- Deep expertise in AWS cloud platforms and familiarity with a range of AWS Analytics Ecosystem components, including but not limited to Apache Airflow, Apache Spark, S3, Glue, Kafka, AWS Athena, Lambda, Redshift, Lake Formation, AWS Batch, ECS - Fargate, Kinesis, Flink, DynamoDB, and SageMaker.

- Advanced proficiency with IaC tool Terraform.

3) Role: Sr. Platform Engineer / Cloud Engineer (Terraform, AWS, Python)

- Relevant Exp. 5+ Years

- Immediate joiner

- For a Healthcare Client

Hyderabad Location

Skills:

Python Programming

DevOps

Must have experience in infrastructure through code using Terraform

AWS

SQL

If any One interested for these positions please fill this Google Form:

https://forms.gle/PhNV2auWEUsUqJXv9



  • Kannur, Kerala, India SID Information Technologies Full time

    Role: Data Engineering Manager Data Architect)Location: HyderabadExperience: 10–15 Years (Hands-on)Availability: Immediate JoinerClient: Healthcare Data AnalyticsKey Skills: Python, Scala, SQLAWS (Redshift, S3, Glue, Lambda, Athena, Lake Formation, DynamoDB, SageMaker, etc.)Terraform, Jenkins, GitHub Actions / GitLab CI/CDDocker & KubernetesPlatform...


  • Kannur, Kerala, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeaderWe are seeking an experienced Data Engineering Leader to join our team.Key Responsibilities:Lead the design, development, and deployment of data engineering solutions.Collaborate with cross-functional teams to identify business requirements and develop technical solutions.Develop and maintain high-quality, scalable data...


  • Kannur, Kerala, India beBeeDataEngineer Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Job DescriptionThe ideal candidate will have a strong background in data engineering, data architecture, and data integration. We are seeking an expert who can design, develop, and implement scalable data pipelines to drive business growth.Required Skills and QualificationsOver 6 years experience as a Data Engineer or in a similar role with expertise in data...


  • Kannur, Kerala, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistWe are seeking a highly skilled and experienced data engineer to join our team.About the RoleThe ideal candidate will have a strong background in data engineering, with experience working on large-scale data pipelines and a proven track record of delivering high-quality solutions.The role will involve designing,...


  • Kannur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering SpecialistWe're seeking a skilled Data Engineering Specialist to design, develop, and maintain scalable, high-performance data solutions using Databricks. The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture.About the Role:The Data Engineering Specialist will...

  • Lead Data Engineer

    3 days ago


    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job SummaryWe are seeking a highly skilled Python Data Engineer to lead our on-premise data engineering efforts.This is an exceptional opportunity for a seasoned professional to leverage their expertise in designing, developing, and optimizing ETL pipelines using tools like Apache Nifi, Talend, or Pentaho.Main Responsibilities:ETL Development & Optimization:...


  • Kannur, Kerala, India beBeeDataEngineer Full time US$ 9,00,000 - US$ 13,00,000

    Job Title: Data Engineer LeadKey Responsibilities:Data Engineer Lead Job DescriptionThe role involves end-to-end delivery of data modules and platforms that power core business use cases across real-time bidding, reporting, and analytics.As a senior leader in the team, you will own the design and enhancement of data-heavy modules across ad serving,...


  • Kannur, Kerala, India beBeeData Full time ₹ 12,00,000 - ₹ 19,00,000

    Efficiently design and implement scalable data infrastructure using cutting-edge tools.About the Role:Develop and maintain high-quality code for data processing and analysis, focusing on performance optimization and troubleshooting.Collaborate with cross-functional teams to integrate data engineering capabilities into the organization, driving business...


  • Kannur, Kerala, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering Leadership OpportunityThis exciting role involves overseeing the migration of an on-premises Enterprise Data Warehouse to a modern cloud-based data platform.You will be responsible for managing and leading this project, utilizing Azure Cloud data tools and Snowflake. This will enable offshore resources to build and develop Reporting,...

  • Big Data Engineer

    3 weeks ago


    Kannur, Kerala, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...