Lead Data Engineer
6 days ago
Important Note (Please Read Before Applying)🚫 Do NOT apply if:You have less than 10 years or more than 12 years of total IT experienceYou do not have hands-on experience with Python and GCP Data Engineering projectsYou lack real-world experience in building and deploying ETL/ELT pipelines using GCP services (Dataflow, BigQuery, Composer, etc.)You have no exposure to Apache Spark, Kafka, or AirflowYou are on a notice period longer than 30 daysYou are looking for a purely remote role (onsite/client engagement required)You come from a non-data background (e.g., testing, support, or non-engineering roles)✅ Apply ONLY if you meet ALL mandatory skills and criteria above.Job Title: Lead Data Engineer - GCP + PythonLocation: HyderabadYears of Experience: 10+YearsAbout the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Job Description :Key Responsibilities: ● Design, develop, test, and maintain scalable ETL data pipelines using Python.● Architect the enterprise solutions with various technologies like Kafka,multi-cloud services, auto-scaling using GKE, Load balancers, APIGEE proxy APImanagement, DBT, using LLMs as needed in the solution, redaction of sensitiveinformation, DLP (Data Loss Prevention) etc.● Work extensively on Google Cloud Platform (GCP) services such as:○ Dataflow for real-time and batch data processing○ Cloud Functions for lightweight serverless compute○ BigQuery for data warehousing and analytics○ Cloud Composer for orchestration of data workflows (on Apache Airflow)○ Google Cloud Storage (GCS) for managing data at scale○ IAM for access control and security○ Cloud Run for containerized applicationsRequired Skills: ● 10 to 12 years of hands-on experience in Python for backend or data engineeringprojects.● Strong understanding and working experience with GCP cloud services(especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).● Solid understanding of data pipeline architecture, data integration, andtransformation techniques.● Experience in working with version control systems like GitHub and knowledge ofCI/CD practices.● Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs.● Strong experience in SQL with at least one enterprise database (SQL Server,Oracle, PostgreSQL, etc.).● Experience in data migrations from on-premise data sources to Cloud platforms.✅ Mandatory SkillsStrong hands-on expertise in Python for backend and data engineering projects✔ Proven experience in Google Cloud Platform (GCP) — especially Dataflow, BigQuery, Cloud Composer, Cloud Functions, GCS, and IAM✔ Strong understanding of ETL/ELT pipeline design, architecture, and development✔ Hands-on experience with Apache Spark, Kafka, and Airflow (GCP Composer DAGs)✔ Experience in developing APIs using Python FastAPI framework✔ Experience with GKE (Google Kubernetes Engine) and Cloud Run for deployment✔ Strong SQL skills with enterprise databases (SQL Server / Oracle / PostgreSQL)✔ Familiarity with NoSQL databases like MongoDB, Redis, or Bigtable✔ Proficient in Git/GitHub and CI/CD pipeline deployments for data projects✔ Experience in data migration from on-premise sources to Cloud platforms✔ Solid knowledge of data quality, validation, monitoring, and data governance best practices
-
Lead Data Engineer
1 week ago
Hyderabad, Telangana, , India The Modern Data Company Full time ₹ 15,00,000 - ₹ 30,00,000 per yearRole Overview:The Lead Data Engineer is a senior technical leader responsible for architecting end -to -end data flow solutions and guiding the engineering team to deliver complex data projects. In this role, you will design data flow architectures that solve complex business problems, ensuring that all components (ingestion, processing, storage, and access)...
-
Azure Data Engineer
1 week ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Azure Data Engineer
14 hours ago
Hyderabad, Telangana, India Enable Data Full time ₹ 6,00,000 - ₹ 18,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
-
Lead Engineer
3 days ago
Hyderabad, India NTT DATA Full timeJob Description – Support Engineer (Data Practice) – Snowflake, Airflow, IICSRole: Support EngineerJob Summary:We are looking for a Support Engineer in Data Practice with expertise in Snowflake, Apache Airflow, and Informatica IICS (Intelligent Cloud Services). The ideal candidate will be responsible for monitoring, troubleshooting, and optimizing data...
-
Operations Data Lead
2 weeks ago
Hyderabad, India Data Unveil Full timePosition Title: Operations Data Lead Experience: 5 Years to 6 Years Location: Hyderabad, Telangana Hire Type: Full Time, On-site Start Date: Immediate Overview: The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...
-
Operations Data Lead
1 week ago
hyderabad, India Data Unveil Full timePosition Title: Operations Data Lead Experience: 5 Years to 6 Years Location: Hyderabad, Telangana Hire Type: Full Time, On-site Start Date: Immediate Overview: The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...
-
Operations Data Lead
2 weeks ago
Hyderabad, India Data Unveil Full timePosition Title: Operations Data Lead Experience: 5 Years to 6 YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery processes are...
-
Operations Data Lead
1 week ago
Hyderabad, India Data Unveil Full timePosition Title: Operations Data Lead Experience: 5 Years to 6 YearsLocation: Hyderabad, TelanganaHire Type: Full Time, On-siteStart Date: ImmediateOverview:The Operations Data Delivery Lead is responsible for managing and overseeing the efficient delivery of data within the organization. This role ensures that data operations and delivery...
-
Hyderabad, Telangana, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearJob summary The PeopleSoft to Workday Data Conversion Technical Lead will be responsible for the technical design, development, and execution of the data migration from PeopleSoft to Workday. This hands-on role requires deep technical expertise in both PeopleSoft and Workday data structures and tools. The lead will manage the technical conversion team,...
-
Azure Data Engineer With Snowflake
2 weeks ago
Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 25,00,000 per yearEnable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...
