Big Data Engineer
2 days ago
Spark Scala Developer
Location : Bengaluru, Mumbai
Employment Type : Full-time
What Were Looking For
Were hiring a
Spark Scala Developer
who has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scalas functional style. Experience with cloud platforms and modern data tools like Snowflake or Databricks is a strong plus.
Your Responsibilities
- Design and develop scalable data pipelines using Apache Spark and Scala
- Optimize and troubleshoot Spark jobs for performance (e.g. memory management, shuffles, skew)
- Work with massive datasets in on-prem Hadoop clusters or cloud platforms like AWS/GCP/Azure
- Write clean, modular Scala code using functional programming principles
- Collaborate with data teams to integrate with platforms like Snowflake, Databricks, or data lakes
- Ensure code quality, documentation, and CI/CD practices are followed
Must-Have Skills
- 3+ years of experience with Apache Spark in Scala
- Deep understanding of Spark internalsDAG, stages, tasks, caching, joins, partitioning
- Hands-on experience with performance tuning in production Spark jobs
- Proficiency in Scala functional programming (e.g. immutability, higher-order functions, Option/Either)
- Proficiency in SQL
- Experience with any major cloud platform: AWS, Azure, or GCP
Nice-to-Have
- Worked with Databricks, Snowflake, or Delta Lake
- Exposure to data pipeline tools like Airflow, Kafka, Glue, or BigQuery
- Familiarity with CI/CD pipelines and Git-based workflows
- Comfortable with SQL optimization and schema design in distributed environments
)
-
Big Data Engineer
4 days ago
Mumbai, Maharashtra, India HirePower Staffing Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...
-
Big Data Engineer
3 weeks ago
Mumbai, Maharashtra, India, Maharashtra HirePower Staffing Solution Full timePosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...
-
Big Data Engineer
6 days ago
Mumbai, Maharashtra, India NovoTree Minds Consulting Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilities: - Proven experience in SQL, Spark, Hadoop ecosystem - Have worked on multiple TBs of data volume from ingestion to consumption. - Work with business stakeholders to identify and document high impact business problems and potential solutions. - Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop...
-
Big Data Engineer
6 days ago
Mumbai, Maharashtra, India NIELSEN Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description Opening from Nielsen - All locations (Gurgaon / Bangalore / Mumbai) At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with...
-
Big Data Developer
6 days ago
Navi Mumbai, Maharashtra, India Smartavya Analytica Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title: Big Data DeveloperLocation: Navi Mumbai, IndiaExp: 5+ YearsDepartment: Big Data and CloudJob Summary: Smartavya Analytica Private Limited is seeking a skilled Hadoop Developer to join our team and contribute to the development and maintenance of large-scale Big Data solutions. The ideal candidate will have extensive experience in Hadoop ecosystem...
-
Data Platform Engineer
2 weeks ago
Mumbai, Maharashtra, India Xoriant Full time ₹ 8,00,000 - ₹ 24,00,000 per yearRole & responsibilitiesAs a Big Data Platform Engineer you will be responsible for the technical delivery of our Data Platform's core functionality and strategic solutions. This includes the development of reusable tooling/API's, applications, data stores, and software stack to accelerate our relational data warehousing, big data analytics and data...
-
Mumbai, Maharashtra, India Bitkraft Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per yearSummary- Bitkraft Technologies LLP is looking for Technical Architect to join our software engineering team- You will be working across the stack on cutting edge web development projects for our custom services business.- As a Senior Technical Architect, you play a pivotal role in designing, developing, and implementing cutting-edge data processing...
-
Software Test Engineer
1 week ago
Mumbai, Maharashtra, India Big Rattle Technologies | Big Rattle AI Full time ₹ 40,00,000 - ₹ 1,20,00,000 per yearJob Description of Software Test EngineerExperience Level:1 to 2 yearsLocation:MumbaiCompany:Big Rattle Technologies Private LimitedOpen for candidates from Mumbai onlyImmediate Joiners onlyJob Summary:We are looking for a results-driven Software Test Engineer responsible for designing, writing test cases, and running automated tests for software developed...
-
Data Engineer
6 days ago
Mumbai, Maharashtra, India Team Computers Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description Data Engineer Position: Data EngineerExperience: 3-4 years Responsibilities:Design, build, and optimize data pipelines and architectures. Data integration and transformation. Ensure scalability and reliability of data infrastructure. Essential Skills:ETL Data modeling SQL Cloud platforms Big data technologies Job...
-
Google Big Query
6 days ago
Mumbai, Maharashtra, India Launch It Consulting Full time ₹ 1,20,000 - ₹ 3,00,000 per yearGoogle Big QueryDescription: Be a part of our success story. Launch offers talented and motivated people the opportunity to do the best work of their lives in a dynamic and growing company. Through competitive salaries, outstanding benefits, internal advancement opportunities, and recognized community involvement, you will have the chance to create a career...