Big Data Engineer

1 week ago

Hyderabad, Telangana, India Techno Facts Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.

Position Requirements :

Must Have : Build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimize ETL/ELT processes for structured and unstructured data. Knowledge of Lakehouse architecture for efficient data storage, processing, and analytics. Orchestrating ETL/ELT Pipelines: Design and manage data workflows using Databricks Workflows, Jobs API. Worked with AWS Data Services (S3, Lambda, CloudWatch) for seamless integration. Performance Optimization: Optimize queries using pushdown capabilities and indexing strategies. Worked on data governance with Unity Catalog, security policies, and access controls. Monitor, troubleshoot, and improve Databricks jobs and clusters. Exposure to end-to-end implementation of migration projects to AWS Cloud AWS & Python Expertise with hands-on cloud development. Orchestration: Airflow Code Repositories: Git, GitHub. Strong in writing SQL Cloud Data Migration: Deep understanding of processes. Strong Analytical, Problem-Solving & Communication Skills

Good to have Knowledge / Skills : Experience in Teradata, DataStage , SSIS Knowledge of Databricks Delta Live Table. Knowledge of Delta Lake. Streaming: Kafka, Spark Streaming. CICD: Jenkins IaC & Automation: Terraform for Databricks deployment.

Educational Background : BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA

Certification : Amazon Web Services (AWS) certifications (AWS certified Data Engineer is recommended).  Databricks Certified Associate Developer for Apache Spark

Drop resume to Mail id-sailaja.-

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Sky Systems, Inc. (SkySys) Full time

    Role:Big Data EngineerPosition Type:Full-Time Contract (40hrs/week)Contract Duration:Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilledBig Data Engineer (5+ years' experience)to join Experian's dynamic data engineering team. You will design and optimize scalable data pipelines,...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India IDESLABS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are looking for a skilled Big Data Engineer with 6 to 22 years of experience. The ideal candidate will have expertise in Pyspark, Azure Data Bricks, and workflows. This position is available as a contract role across Pan India.Roles and ResponsibilityDesign and develop scalable big data systems using Pyspark and Azure Data Bricks.Implement and manage...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Incedo Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineers – Big Data Platform At Incedo, we're looking for experienced Big Data Engineers (5–8 years) to join our AI & Data team in Hyderabad — and be part of building cutting-edge data ecosystems for the Banking domain. What You'll Do • Design, develop & optimize large-scale data pipelines using Hadoop, Hive, HDFS, and Kafka •...

  • Big Data Engineer

    3 days ago

    Hyderabad, Telangana, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Position : Big Data Engineer Location : Hyderabad, India (Hybrid, 2-3 times per week on any weekdays) Duration : 1 year Job Summary : Experian FSD is seeking a skilled and motivated Big Data Engineer to join our dynamic data engineering team. This hybrid role based in Hyderabad offers the opportunity to work on cutting-edge data...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Vaakruthi Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesJob Description : Big Data EngineerAnalyze, Code , Test and Implement Big Data Applications (API & Batch) Manage and mitigate incidentsRequired Qualifiactions:years of experience in analysis, coding, implementation and testing of Big Data Applications (API & Batch) on AWS Cloud using java/scala/kotlin, Cassandra,Python, Hadoop, HDFS,...

  • Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Operations Engineer

    3 days ago

    Hyderabad, Telangana, India S M Software Solutions Inc Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description – Big Data Operations EngineerLocation :Onsite, Hyderabad SoftilityExperience: 5+ yearsRole OverviewWe are looking for a skilledBig Data Operations Engineerwith hands-on experience in supporting and maintaining large-scale data platforms. The role involves ensuring platform availability, managing incidents, monitoring performance through...

  • Big Data Developer

    2 weeks ago

    Hyderabad, Telangana, India Alp Consulting Ltd. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title:Big Data DeveloperWork Location:Hyderabad, Telangana (TG), IndiaExperience Range:6–8 YearsSkill Area:Digital – Big Data and Hadoop EcosystemsJob Description:We are looking for an experienced and results-drivenBig Data Developerto join our dynamic team in Hyderabad. The ideal candidate will have a strong background in designing, developing, and...

  • Big Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India, Telangana Rapinno Tech Solutions Pvt.Ltd. Full time

    Big Data Engineer Locations: Hyderabad | Chennai | Pune | Bangalore Skills: Scala, Python, Apache Spark, PySpark, AWS, CI/CD Experience: 3 to 11 years Scala Developer Multiple Locations Strong hands-on experience in Scala & distributed data processing