Big Data Specialist

2 weeks ago

Chennai, Tamil Nadu, India beBeeDataSpecialist Full time US$ 1,80,000 - US$ 2,00,000
Job Title: Big Data Specialist

We are seeking a talented professional to join our team as a Big Data Engineer.

About the Role:

The ideal candidate will possess strong programming skills in Python and PySpark, along with a solid understanding of HDFS, Hive, and Spark architecture.

Key Responsibilities:

Building scalable ETL workflows and handling large datasets is crucial for this position. The successful candidate will also have experience with Delta Lake and Apache Iceberg table formats, proficiency in working with Avro, ORC, and Parquet file formats.

Required Skills and Qualifications:

  • Strong programming skills in Python and PySpark.
  • Solid understanding of HDFS, Hive, and Spark architecture.
  • Experience with Delta Lake and Apache Iceberg table formats.
  • Proficiency in working with Avro, ORC, and Parquet file formats.

Nice to Have:

  • Experience with SAS SPDE tables and migration strategies.
  • Exposure to Starburst or Databricks platforms.
  • Understanding of modern data lakehouse architectures and query engines.

  • Senior Big Data Professional

    1 week ago

    Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data SpecialistHiring for a Big Data specialist with expertise in Hadoop and its ecosystem. The ideal candidate will have hands-on experience with Hadoop, Hive, SQL, Spark, and other Big Data tools.ResponsibilitiesDelivering code and setting up the environmentEnsuring connectivity and deploying the code in production after testingWorking closely with the...

  • Big Data Processing Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Processing Specialist We are seeking a highly skilled Big Data Processing Specialist with expertise in Python programming and the PySpark framework. The ideal candidate will have hands-on experience working with AWS Glue, parallel batch processing, and popular libraries such as pandas and numpy. This role requires knowledge of other AWS...

  • Senior Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataScience Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data SpecialistThe ideal candidate will have 4+ years of hands-on experience in big data development, utilizing programming languages such as Java and Scala.Develop and maintain scalable big data applications using various technologies.Collaborate with cross-functional teams to design and implement robust big data solutions.Stay up-to-date with emerging...

  • Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data DeveloperWe are looking for a highly skilled Big Data Developer to join our team. In this role, you will be responsible for developing and fine-tuning programs/applications using Python/PySpark/Scala on Big Data/Hadoop Platform.The ideal candidate will have strong knowledge of Big Data/Hadoop Platform and experience with Spark, PySpark, Python,...

  • Senior Big Data Specialist

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a key member of the data engineering group, you will be responsible for designing and implementing scalable data pipelines to support our business needs.Key Responsibilities:Design and implement data pipelines using Big Data Technologies like Spark, Hive, and HadoopCollaborate...

  • Big Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India Impacteers Full time

    Position Overview :We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The role involves working with large datasets, integrating diverse data sources, and ensuring data availability for analytics, machine learning, and business intelligence. The ideal candidate will...

  • Big Data Developer

    3 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python) Location: Chennai, Bangalore, Gurugram Experience Required: 5+ years (5 to 15 yrs) Joining: Immediate or Early Joiners Preferred Employment Type: Full-time Job Summary: We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal...

  • Big Data Developer

    2 weeks ago

    Chennai, Tamil Nadu, India IntraEdge Full time

    Job Title: Big Data Developer (Java/Python)Location: Chennai, Bangalore, GurugramExperience Required: 5+ years (5 to 15 yrs)Joining: Immediate or Early Joiners PreferredEmployment Type: Full-timeJob Summary:We are looking for a passionate and experienced Big Data Developer with expertise in either Java or Python to join our dynamic team. The ideal candidate...