Big Data Developer

2 days ago

Hyderabad India Miamin Systems Full time

Job Description About the Role We are looking for a skilled Big Data Engineer to design, build, and optimize scalable data pipelines and big data platforms. The ideal candidate will have strong hands-on experience with data processing frameworks, cloud platforms, and real-time data systems. Key Responsibilities - Design, develop, and maintain large-scale data pipelines and ETL workflows - Work with Hadoop, Spark, Kafka, Hive, and other big data technologies - Optimize data processing jobs for performance, scalability, and reliability - Build and manage real-time and batch data processing systems - Collaborate with data scientists, analysts, and engineering teams to deliver high-quality data solutions - Ensure data quality, security, and governance across all pipelines - Deploy and manage data solutions on cloud platforms (AWS/Azure/GCP) - Monitor data infrastructure performance and troubleshoot issues Required Skills & Experience - 37 years of experience as a Big Data Engineer or related role - Strong programming skills in Python/Scala/Java - Hands-on experience with Apache Spark, Kafka, Hadoop, Hive, HBase, etc. - Experience with cloud data services: - AWS (Glue, EMR, Redshift) - Azure (Databricks, Synapse) - GCP (Dataflow, BigQuery) - Solid understanding of ETL, data warehousing, distributed systems - Experience with SQL and NoSQL databases - Familiarity with CI/CD and containerization (Docker, Kubernetes) Nice to Have - Experience with Databricks - Knowledge of Airflow or other workflow schedulers - Exposure to machine learning data pipelines

  • Big Data Developer

    1 week ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    1 week ago

    Hyderabad, Telangana, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    1 week ago

    Hyderabad, Telangana, India MobMaxime Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable big data systems and pipelines.Implement data processing frameworks and optimize large datasets using tools such as Hadoop, Spark, and Hive.Develop and maintain ETL processes to ensure data availability, accuracy, and quality for downstream applications.Collaborate with data architects, analysts,...

  • Big Data Developer

    3 weeks ago

    Hyderabad, India Virtusa Full time

    Big Data Developer - CREQ Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix...

  • Big Data Developer

    7 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - BigdataExperience: 4 to 8 YearsLocation: Hyderabad,Chennai, BangaloreJob DescriptionRequired Skills:4+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging...

  • Big Data Developer

    4 hours ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    7 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - Bigdata Experience: 4 to 8 Years Location: Hyderabad,Chennai, Bangalore Job Description Required Skills: 4+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark...

  • Big Data Developer

    4 hours ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    Greetings from Tata Consulting ServicesTCS is Hiring for Big Data DeveloperExperience : 4-10 yearsLocation: Chennai/Hyderabad/Bangalore Please find the JD belowRequired Technical Skill - Pyspark, Hadoop,Hive

  • Big Data Developer

    1 day ago

    Hyderabad, India Tata Consultancy Services Full time

    Big Data Developer - 4 - 10 YearsMust-Have Experience in Web development using React, NodeJs/NestJSGood-to-Have Knowledge in Mongo DB.Skills: HTML, CSS, JavaScript, React, NodeJs, UI/UX experience

  • Big data developer

    1 day ago

    Hyderabad, India Tata Consultancy Services Full time

    Big Data Developer - 4 - 10 YearsMust-Have Experience in Web development using React, Node Js/Nest JSGood-to-Have Knowledge in Mongo DB.Skills: HTML, CSS, Java Script, React, Node Js, UI/UX experience