Big Data Engineer
1 day ago
Description :
Job Summary :
We are looking for an experienced Big Data Engineer to design, build, and optimize data pipelines and infrastructure supporting large-scale data processing and analytics.
You will be instrumental in migrating our legacy systems to a modern, scalable data platform.
Key Responsibilities :
- ETL/ELT Pipeline Development: Design, construct, and maintain robust, scalable, and fault-tolerant ETL/ELT pipelines for ingesting and transforming high-volume, high-velocity data using Apache Spark or Databricks.
- Data Warehousing: Implement and manage modern data warehousing solutions on the cloud, utilizing platforms like Snowflake, AWS Redshift, or Google BigQuery.
- Data Architecture: Evaluate and implement optimal database solutions (relational, NoSQL, data lake technologies like Delta Lake or Hudi) for different use cases.
- Performance Optimization: Tune and optimize Spark jobs and database queries for maximum performance and cost efficiency.
- Automation & Monitoring: Integrate data pipelines with workflow management tools like Apache Airflow and establish monitoring and alerting for data quality and pipeline health.
Required Technical Skills :
- Big Data Frameworks: Expert proficiency with Apache Spark (PySpark or Scala).
- Programming: Strong skills in Python or Scala.
- Databases/Warehousing: Expertise in SQL and hands-on experience with modern data warehouses (Snowflake, Redshift, BigQuery).
- Workflow Orchestration: Hands-on experience with Apache Airflow or similar tools.
- Cloud & Storage: Experience with cloud storage services (AWS S3, Azure Data Lake Storage, Google Cloud Storage) and cloud platform services.
- Streaming (Bonus): Familiarity with real-time streaming technologies like Kafka or Kinesis
-
Big Data Engineer
2 weeks ago
Mumbai, Maharashtra, India HirePower Staffing Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...
-
Big Data Engineer
3 days ago
Mumbai, Maharashtra, India Infogain Full time US$ 90,000 - US$ 1,20,000 per yearRoles & Responsibilities3 to 5 years of experience in Data Engineering.Hands-on experience with Azure data tools: ADF, Data Lake, Synapse, Databricks.Strong programming skills in SQL and PythonGood understanding of Big Data frameworksKnowledge of data modeling, warehousing, and performance tuning.Familiarity with CI/CD, version control (Git), and Agile/Scrum...
-
Big Data Engineer
4 weeks ago
Mumbai, Maharashtra, India, Maharashtra HirePower Staffing Solution Full timePosition Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...
-
Big Data Developer
7 days ago
Mumbai, Maharashtra, India Progriz Coe Full time ₹ 12,00,000 - ₹ 24,00,000 per year,On-site,,Job Title: Training & Mentorship Specialist Big Data & Cloud TechnologiesLocation: Onsite Lower Parel MumbaiEmployment Type: Full-time Role Overview:We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices....
-
Big Data Engineer
2 weeks ago
Mumbai, Maharashtra, India NovoTree Minds Consulting Private Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearResponsibilities: - Proven experience in SQL, Spark, Hadoop ecosystem - Have worked on multiple TBs of data volume from ingestion to consumption. - Work with business stakeholders to identify and document high impact business problems and potential solutions. - Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop...
-
Big Data Engineer
2 weeks ago
Mumbai, Maharashtra, India NIELSEN Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Description Opening from Nielsen - All locations (Gurgaon / Bangalore / Mumbai) At Nielsen, we are passionate about our work to power a better media future for all people by providing powerful insights that drive client decisions and deliver extraordinary results. Our talented, global workforce is dedicated to capturing audience engagement with...
-
Big Data Engineer
1 week ago
Mumbai, Maharashtra, India Strategic HR Solutions Full time ₹ 8,00,000 - ₹ 15,00,000 per yearSpark Scala DeveloperLocation : Bengaluru, MumbaiEmployment Type : Full-timeWhat Were Looking ForWere hiring aSpark Scala Developerwho has real-world experience working in Big Data environments, both on-prem and/or in the cloud. You should know how to write production-grade Spark applications, fine-tune performance, and work fluently with Scalas functional...
-
Big Data Developer
2 weeks ago
Navi Mumbai, Maharashtra, India Smartavya Analytica Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title: Big Data DeveloperLocation: Navi Mumbai, IndiaExp: 5+ YearsDepartment: Big Data and CloudJob Summary: Smartavya Analytica Private Limited is seeking a skilled Hadoop Developer to join our team and contribute to the development and maintenance of large-scale Big Data solutions. The ideal candidate will have extensive experience in Hadoop ecosystem...
-
Senior Technical Architect Big Data Technologies
2 weeks ago
Mumbai, Maharashtra, India Bitkraft Technologies Full time ₹ 15,00,000 - ₹ 20,00,000 per yearSummary- Bitkraft Technologies LLP is looking for Technical Architect to join our software engineering team- You will be working across the stack on cutting edge web development projects for our custom services business.- As a Senior Technical Architect, you play a pivotal role in designing, developing, and implementing cutting-edge data processing...
-
Data Engineer
5 days ago
Mumbai, Maharashtra, India Tata Power Full time ₹ 12,00,000 - ₹ 36,00,000 per yearRole & responsibilities7 to 12+ years of hands-on experience in SQL database design, data architecture, ETL, Data Warehousing, Data Mart, Data Lake, Big Data, Cloud (AWS) and Data Governance domains.Take ownership of the technical aspects of implementing data pipeline & migration requirements, ensuring that the platform is being used to its fullest potential...