Big Data Developer

3 weeks ago

Pune, India Populace World Solutions Full time

Description : Big Data DeveloperLocation : Pune, IndiaExperience : 7+ YearsAbout the Role : We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate has a deep background in the modern data ecosystem, with expertise in Python, PySpark, and cloud-based data analytics services, and a proven ability to solve complex data transformation challenges.Key Responsibilities : - Big Data Development : Design, build, and maintain robust, scalable, and highly performant data pipelines using Python and PySpark.- Data Architecture : Work extensively with core Big Data technologies, including Hadoop and Apache Spark, to process vast datasets.- Platform Expertise : Leverage deep knowledge of the Databricks platform to manage and execute data workloads efficiently.- Data Structuring : Implement best practices for data storage and querying, with extensive, hands-on experience utilizing Delta Tables and working with various file formats such as JSON and Parquet.- Cloud Integration : Develop and deploy solutions leveraging AWS data analytics services.- Problem Solving : Tackle and resolve complex data processing and transformation-related problems, ensuring data quality, accuracy, and performance.- Database Management : Apply solid knowledge of both NoSQL and RDBMS databases in data ingestion and integration workflows.- Collaboration : Utilize good communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and other engineering teams.Required Qualifications : - Experience : 7+ years of professional experience as a Big Data Engineer or in a similar role.- Programming Proficiency : Must be proficient with Python & PySpark.- Core Big Data : In-depth, practical knowledge of Hadoop and Apache Spark.- Data Lake/Warehouse Technologies : Extensive hands-on experience with Databricks and deep familiarity with Delta Tables.- File Formats : Must have extensive experience working with and optimizing data stored in JSON and Parquet file formats.- Database Knowledge : Solid understanding and working knowledge of both NoSQL and RDBMS databases.- Analytical Skills : Proven ability to analyze and solve complex data processing, transformation, and optimization Qualifications : - Cloud Data Services : Experience with AWS data analytics services such as Athena, Glue, Redshift, and EMR.- Data Warehousing : Familiarity and practical experience with Data Warehousing concepts and methodologies will be a plus. (ref:hirist.tech)

  • Big Data Developer

    4 days ago

    Pune, Maharashtra, India airtel Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Job Title:Big Data Developer (Manager)Location: PuneExperience: 3-5 yearsJob Description:Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Developer

    2 weeks ago

    pune, India UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities: Design, develop, and optimize...

  • Big Data Developer

    4 weeks ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    2 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS!Skill: Big DataYears of Experience: 6 - 8 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS! Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ Chennai Job Description:- Must-Have - PySpark - Hive Good-to-Have - Spark - HBase - DQ tool - Agile Scrum experience - Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    3 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS! Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ Chennai Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS! Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ Chennai Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS! Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ Chennai Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Developer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS! Skill: Big Data Years of Experience: 6 - 8 years Location: Pune/ Mumbai/ Chennai Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big data developer

    3 weeks ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS!Skill: Big DataYears of Experience: 6 - 8 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-HavePy SparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform