Big Data Engineer

4 weeks ago

Mumbai India Strategic HR Solutions Full time

Job Description Spark Scala Developer Location : Bengaluru, Mumbai Employment Type : Full-time What Were Looking For Were hiring a Spark Scala Developer who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scalas functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus. Your Responsibilities - Design and develop scalable data pipelines using Apache Spark and Scala - Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew) - Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/Azure - Write clean, modular Scala code using functional programming principles - Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes - Ensure code quality, documentation, and CI/CD practices are followed Must-Have Skills - 3+ years of experience with Apache Spark in Scala - Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning - Hands-on experience with performance tuning in production Spark jobs - Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either) - Proficiency in SQL - Experience with any major cloud platform: AWS, Azure, or GCP Nice-to-Have - Worked with Databricks, Snowflake, or Delta Lake - Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery - Familiarity with CI/CD pipelines and Git-based workflows - Comfortable with SQL optimization and schema design in distributed environments (ref:hirist.tech)

  • Big Data Engineer

    2 weeks ago

    India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Job description for Data engineer: Education/Experience: • Bachelor's degree in computer science or equivalent training required. Big Data Engineer: Years Experience in developing Big Data processing applications on Azure Databricks. 2. Profound experience with developing Big Data applications using Spark and Scala/Python. 3. Good experience in working...

  • Big Data Engineer

    3 weeks ago

    Mumbai, India HirePower Staffing Solution Full time

    Position Overview: We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent. You...

  • Big data engineer

    4 weeks ago

    Mumbai, India HirePower Staffing Solution Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Engineer

    2 weeks ago

    Mumbai, India HirePower Staffing Solution Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Engineer

    2 days ago

    Mumbai City, Kolkata, Mumbai, India Krazy Mantra It Full time

    Job Description Key Responsibilities: - Data Architecture: Design and implement scalable storage solutions using Hadoop, NoSQL databases, HBase, and Cassandra. - Big Data Processing: Develop and maintain pipelines using Apache Spark, Apache Storm, Apache Pig, MapReduce, and Oozie. - Scripting & Development: Write and test data processing scripts using...

  • Big Data Engineer

    4 days ago

    Pune, India Coforge Full time

    Job Description Coforge Ltd is Hiring for Big Data Engineer AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: [Confidential Information] For queries, contact via WhatsApp: 9667427662 Key Responsibilities:- Design, develop, and optimize Big Data...

  • Big Data Engineer

    5 days ago

    Mumbai, Maharashtra, India Infogain Full time US$ 90,000 - US$ 1,20,000 per year

    Roles & Responsibilities3 to 5 years of experience in Data Engineering.Hands-on experience with Azure data tools: ADF, Data Lake, Synapse, Databricks.Strong programming skills in SQL and PythonGood understanding of Big Data frameworksKnowledge of data modeling, warehousing, and performance tuning.Familiarity with CI/CD, version control (Git), and Agile/Scrum...

  • Big Data Engineer

    2 days ago

    Mumbai, Maharashtra, India RiskInsight Consulting Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...