▷ Only 24h Left Big Data Engineer

2 weeks ago

Hyderabad, India Teamware Solutions Full time

Job Description Key Responsibilities: - Design, develop, and optimize big data pipelines and ETL workflows using PySpark, Hadoop (HDFS, MapReduce, Hive, HBase). - Develop and maintain data ingestion, transformation, and integration processes on Google Cloud Platform services such as BigQuery, Dataflow, Dataproc, and Cloud Storage. - Ensure data quality, security, and governance across all pipelines. - Monitor and troubleshoot performance issues in data pipelines and storage systems. - Collaborate with data scientists and analysts to understand data needs and deliver clean, processed datasets. - Implement batch and real-time data processing solutions. - Write efficient, reusable, and maintainable code in Python and PySpark. - Automate deployment and orchestration using tools like Airflow, Cloud Composer, or similar. - Stay current with emerging big data technologies and recommend improvements. Qualifications and Requirements: - Bachelor's or Master's degree in Computer Science, Engineering, or related field. - 3+ years of experience in big data engineering or related roles. - Strong hands-on experience with Google Cloud Platform (GCP) services for big data processing. - Proficiency in Hadoop ecosystem tools: HDFS, MapReduce, Hive, HBase, etc. - Expert-level knowledge of PySpark for data processing and analytics. - Experience with data warehousing concepts and tools such as BigQuery. - Good understanding of ETL processes, data modeling, and pipeline orchestration. - Programming proficiency in Python and scripting. - Familiarity with containerization (Docker) and CI/CD pipelines. - Strong analytical and problem-solving skills. Desirable Skills: - Experience with streaming data platforms like Kafka or Pub/Sub. - Knowledge of data governance and compliance standards (GDPR, HIPAA). - Familiarity with ML workflows and integration with big data platforms. - Experience with Terraform or other infrastructure-as-code tools. - Certification in GCP Data Engineer or equivalent.

  • (Only 24h Left) Data Engineer

    4 weeks ago

    Hyderabad, India People Tech Group Inc Full time

    Job Title: Data Engineer Location: Hyderabad Experience: 5+Years Job Summary: We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline development. Experience...

  • ▷ [Only 24h Left] Data Engineer

    7 days ago

    Hyderabad, India People Tech Group Inc Full time

    Job Title: Data EngineerLocation: HyderabadExperience: 5+YearsJob Summary:We are looking for a skilled and experienced Data Engineer with over 5 years of experience in data engineering and data migration projects. The ideal candidate should possess strong expertise in SQL, Python, data modeling, data warehousing, and ETL pipeline development. Experience with...

  • [Only 24h Left] Data Engineer

    1 week ago

    Hyderabad, India Tanla Platforms Limited Full time

    We are seeking a skilled Data Engineer with 5–10 years of experience to join our dynamic Data Engineering team. The ideal candidate will design, build, and optimize large-scale data pipelines and warehouses that enable real-time analytics and business intelligence across Tanla’s CPaaS ecosystem. You’ll work on diverse datasets, including Call Detail...

  • Only 24h Left: Senior Data Engineer – Big Data

    4 weeks ago

    Hyderabad, India Coforge Full time

    We are hiring for the position of Senior Data Engineer – Big Data & AWS (Python + PySpark) at Coforge Ltd. Job Location: Greater Noida & Hyderabad Only. Experience: 5 to 7 Years Employment Type: Full-Time Send your updated CV to Gaurav.2.Kumar@coforge.com For queries, WhatsApp: 9667427662 If you are a data enthusiast with a passion for building scalable,...

  • [Only 24h Left] Data Engineer

    2 weeks ago

    Hyderabad, India Recro Full time

    Key Responsibilities: - Configure, deploy, and maintain Quantexa software on cloud platforms such as AWS, Azure, or Google Cloud. - Design, implement, and optimize data pipelines and integration workflows within the Quantexa ecosystem. - Collaborate with cross-functional teams to ensure data quality, scalability, and performance in large-scale data...

  • Systems Integration Advisor

    4 weeks ago

    Hyderabad, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Systems Integration Advisor to join our team in Hyderabad, Telangana (IN-TG), India (IN). NTT DATA Services currently...

  • Only 24h Left! Data Engineer

    3 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    TCS has been a great pioneer in feeding the fire of Young techies like you. We are global leaders in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for skill "Data Engineer(Data bricks)". Role: Azure Data Engineer – Databricks Required Technical Skill Set: Data Lake architecture, Azure Services – ADLS, ADF,...

  • Big Data

    2 weeks ago

    Hyderabad, Telangana, India Galaxy i technologies Inc Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Hi, Everyone******CTH Contract Only*******CTH Contract Only*******Job Title: Big Data & Hadoop EcosystemLoc: Hyderabad (WFO)Job Description:Skill Required: Digital: Bigdata and Hadoop EcosystemsExperience Range: 6-8 Years.Job Description:Design, develop, and maintain scalable big data systems and pipelines.Implement data processing frameworks and optimize...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Sky Systems, Inc. (SkySys) Full time

    Role:Big Data EngineerPosition Type:Full-Time Contract (40hrs/week)Contract Duration:Long TermWork Schedule: 8 hours/day (Mon-Fri)Location: Hybrid - Hyderabad, India (3x days onsite/week)We are looking for a skilledBig Data Engineer (5+ years' experience)to join Experian's dynamic data engineering team. You will design and optimize scalable data pipelines,...

  • Big Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Incedo Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineers – Big Data Platform At Incedo, we're looking for experienced Big Data Engineers (5–8 years) to join our AI & Data team in Hyderabad — and be part of building cutting-edge data ecosystems for the Banking domain. What You'll Do • Design, develop & optimize large-scale data pipelines using Hadoop, Hive, HDFS, and Kafka •...