Big Data Developer

1 day ago

Pune, Maharashtra, India Populace World Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Description : Big Data Developer

Location : Pune, India

Experience : 7 Years

About the Role :

We are seeking a highly experienced and technically proficient Big Data Developer to join our team in Pune. In this role, you will be responsible for designing, developing, and optimizing large-scale data processing pipelines and platforms. The ideal candidate has a deep background in the modern data ecosystem, with expertise in Python, PySpark, and cloud-based data analytics services, and a proven ability to solve complex data transformation challenges.

Key Responsibilities :

- Big Data Development : Design, build, and maintain robust, scalable, and highly performant data pipelines using Python and PySpark.

- Data Architecture : Work extensively with core Big Data technologies, including Hadoop and Apache Spark, to process vast datasets.

- Platform Expertise : Leverage deep knowledge of the Databricks platform to manage and execute data workloads efficiently.

- Data Structuring : Implement best practices for data storage and querying, with extensive, hands-on experience utilizing Delta Tables and working with various file formats such as JSON and Parquet.

- Cloud Integration : Develop and deploy solutions leveraging AWS data analytics services.

- Problem Solving : Tackle and resolve complex data processing and transformation-related problems, ensuring data quality, accuracy, and performance.

- Database Management : Apply solid knowledge of both NoSQL and RDBMS databases in data ingestion and integration workflows.

- Collaboration : Utilize good communication skills to effectively collaborate with cross-functional teams, including data scientists, analysts, and other engineering teams.

Required Qualifications :

- Experience : 7 years of professional experience as a Big Data Engineer or in a similar role.

- Programming Proficiency : Must be proficient with Python & PySpark.

- Core Big Data : In-depth, practical knowledge of Hadoop and Apache Spark.

- Data Lake/Warehouse Technologies : Extensive hands-on experience with Databricks and deep familiarity with Delta Tables.

- File Formats : Must have extensive experience working with and optimizing data stored in JSON and Parquet file formats.

- Database Knowledge : Solid understanding and working knowledge of both NoSQL and RDBMS databases.

- Analytical Skills : Proven ability to analyze and solve complex data processing, transformation, and optimization problems.

Desired/Good-to-Have Qualifications :

- Cloud Data Services : Experience with AWS data analytics services such as Athena, Glue, Redshift, and EMR.

- Data Warehousing : Familiarity and practical experience with Data Warehousing concepts and methodologies will be a plus.

  • Big Data Developer

    6 days ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Senior Big Data Developer

    1 week ago

    Pune, Maharashtra, India VR Consultancy Full time ₹ 10,000 - ₹ 30,000 per year

    We are looking for Big Data Engineers who can design, develop, and maintain big data solutions using Spark, Hadoop, PySpark, and other related technologies.Interested candidates can share their resumes

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Varite Full time ₹ 7,00,000 - ₹ 11,00,000 per year

    Job Title : Big Data DeveloperLocation State : MaharashtraLocation City : PuneExperience Required : 6 to 8 Year(s)CTC Range : 7 to 11 LPAShift: Day ShiftWork Mode: OnsitePosition Type: C2HOpenings: 3Company Name: VARITE INDIA PRIVATE LIMITEDAbout The Client: Client is an Indian multinational technology company specializing in information technology services...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data Lead

    7 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Architect

    5 days ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...

  • Big Data

    4 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    3 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Impetus Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionYear of Experience - 1 to 3 yearsLocation - Indore, Pune, Noida, Hyderabad, Bangalore, GurugramRequired Skills:Python Programming: Strong ability to write clean and efficient code.Spark SQL: Good understanding of Spark SQL for distributed data processing.Data Processing: Experience with large datasets and structured data manipulation.SQL...