Big Data Hadoop Engineer

3 weeks ago


Hyderabad, India Anicalls (Pty) Ltd Full time

Candidate should be able to: Work closely with our QA Team to ensure data integrity and overall system quality Work closely with Technology Leadership, Product Managers, and Reporting Team for understanding the functional and system requirements Write Shell/Python scripts for jobs scheduling and data wrangling Write Scoop Jobs to Import/Export data from Hadoop Enhance existing Spark and Java applications, and provide support Generate data reports using HiveQL, Spark SQL or PySpark Develop greenfield data applications using Spark, Java, Python, JDBS/ODBC, and other Hadoop/BigData technologies Design and develop Cloudera HDFS-based solutions using Spark (with interfaces Java, Python, and Spark SQL), Hive QL, Flume, Talend, IBM MQ, and Kafka Candidate should have: Ability to identify problems, and effectively communicate solutions to peers and management Strong debugging skills to troubleshoot production issues Experience in working with real-time data feeds Understanding of Data architecture, replication, and administration Familiarity with Linux OS Exposure to RDBMS: Microsoft SQL Server, Oracle, DB2 Comfortability working in a team environment AWS Cloud Analytics experience Must have 5+ years of experience in using Hadoop/BigData technologies like Spark, Spark SQL, Hive, Flume, Parquet, and Avro file formats, Sqoop, etc. Must have 5+ years of experience in developing applications using Java, Junit, Maven, and its eco-system Must have 2+ years of experience in developing Shell/Python scripts BS/BA degree in Computer Science, Information Systems or related field


  • Big Data Engineer

    1 week ago


    Bengaluru, Chennai, Hyderabad, India Net2source Llp Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Hiring: Big Data/Hadoop Engineer (PySpark, Hive) | 4 to 6 YearsWe are looking for talented Big Data/Hadoop Engineer for one of our premium clientsWork Locations: Bangalore (KA) | Chennai (TN) | Hyderabad (TG)Experience: 4 to 6 YearsRequired Skills:Strong hands-on experience in PySpark and HiveExpertise in Big Data & Hadoop Ecosystem toolsAbility to design...

  • AWS Big Data Engineer

    3 weeks ago


    Hyderabad, India Tiger Analytics Full time

    Job Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing...


  • Hyderabad, India Fusion Plus Solutions Full time

    Job Description Roles and Responsibilities: - Data Engineer/Developer with Cloud (GCP) - Expert in Python, Data Flow, Pubsub, Big Query - Hadoop knowledge, NiFi/Kafka experience Must have: - Good Experience/knowledge on GCP components like GCS, BigQuery, AirFlow, Cloud SQL, PubSub/Kafka, DataFlow and Google Cloud SDK - Understanding of Terraform script,...

  • Big Data Developer

    7 days ago


    Hyderabad, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - BigdataExperience: 4 to 8 YearsLocation: Hyderabad,Chennai, BangaloreJob DescriptionRequired Skills:4+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging...


  • Hyderabad, India Virtusa Full time

    Big Data Python Engineer - CREQ Description Role GDT WS Big Data Python Engineer Exp 5+ Location Pune/Hyderabad MUST Have Skills Design and implement data processing pipelines using Python + SCALA programming and big data technologies such as Hadoop, MapReduce, Hive, and Spark. Airflow Jenkins Understand business requirements to code up data assets in...

  • Big Data

    3 days ago


    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    ResponsibilitiesProvide technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. Monitor system performance, analyze logs, and identify potential issues before they impact services. Collaborate with engineering teams to deploy and configure Hadoop clusters and related components. Assist in maintenance and...

  • Big Data Developer

    7 days ago


    Hyderabad, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - Bigdata Experience: 4 to 8 Years Location: Hyderabad,Chennai, Bangalore Job Description Required Skills: 4+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, Telangana, India Skilviu Soft Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role: Big Data EngineerLocation: Hyderabad, India (Hybrid).Experience: 5+ YearsDuration: 1 year+Notice Period: Immediate -15 days.Key Responsibilities:Design, develop, and maintain scalable data processing pipelines using Spark/PySpark and Hadoop on AWS.Implement and optimize data workflows on AWS EMR, EC2, and ECS.Develop and integrate RESTful APIs and AWS...

  • Big Data Engineer

    1 week ago


    hyderabad, India beBeeBigData Full time

    Job Title: Big Data EngineerAvoid data chaos and master the art of big data management in our esteemed organization.Bachelor's degree in Computer Science or related field with 4-10 years of experienceAbout Us: We offer a dynamic work environment with challenging projects that require innovative problem-solving skills. Our team is known for its collaborative...


  • Hyderabad, India Metasys Technologies Full time

    Big Data Engineer with Gen AIHyderabad, Bangalore, NCR, PuneNotice Period: 30 DaysResponsibilities:Hands-on with Kafka/Kinesis for real-time data processing.Strong SQL skills with experience in database design and data modeling.Experience with Hadoop, Hive, Spark (PySpark/Scala).Good understanding of data warehousing, ETL, data migration &...