Big Data Engineer

5 days ago

Mumbai, India WeAssemble Full time

Description :Job Summary :We are looking for an experienced Big Data Engineer to design, build, and optimize data pipelines and infrastructure supporting large-scale data processing and analytics.You will be instrumental in migrating our legacy systems to a modern, scalable data platform.Key Responsibilities :- ETL/ELT Pipeline Development: Design, construct, and maintain robust, scalable, and fault-tolerant ETL/ELT pipelines for ingesting and transforming high-volume, high-velocity data using Apache Spark or Databricks.- Data Warehousing: Implement and manage modern data warehousing solutions on the cloud, utilizing platforms like Snowflake, AWS Redshift, or Google BigQuery.- Data Architecture: Evaluate and implement optimal database solutions (relational, NoSQL, data lake technologies like Delta Lake or Hudi) for different use cases.- Performance Optimization: Tune and optimize Spark jobs and database queries for maximum performance and cost efficiency.- Automation & Monitoring: Integrate data pipelines with workflow management tools like Apache Airflow and establish monitoring and alerting for data quality and pipeline health.Required Technical Skills :- Big Data Frameworks: Expert proficiency with Apache Spark (PySpark or Scala).- Programming: Strong skills in Python or Scala.- Databases/Warehousing: Expertise in SQL and hands-on experience with modern data warehouses (Snowflake, Redshift, BigQuery).- Workflow Orchestration: Hands-on experience with Apache Airflow or similar tools.- Cloud & Storage: Experience with cloud storage services (AWS S3, Azure Data Lake Storage, Google Cloud Storage) and cloud platform services.- Streaming (Bonus): Familiarity with real-time streaming technologies like Kafka or Kinesis (ref:hirist.tech)

  • Big Data Engineer

    3 weeks ago

    Mumbai, India HirePower Staffing Solution Full time

    Position Overview: We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent. You...

  • Big data engineer

    4 weeks ago

    Mumbai, India HirePower Staffing Solution Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Engineer

    2 weeks ago

    Mumbai, India HirePower Staffing Solution Full time

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Engineer

    2 weeks ago

    Mumbai, Maharashtra, India HirePower Staffing Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview:We are seeking a skilled Big Data Developer to join our growing delivery team, with a dual focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who not only thrives in a technical, fast-paced environment but is also passionate about coaching and developing the next generation of talent.You...

  • Big Data Engineer

    3 days ago

    Mumbai City, Kolkata, Mumbai, India Krazy Mantra It Full time

    Job Description Key Responsibilities: - Data Architecture: Design and implement scalable storage solutions using Hadoop, NoSQL databases, HBase, and Cassandra. - Big Data Processing: Develop and maintain pipelines using Apache Spark, Apache Storm, Apache Pig, MapReduce, and Oozie. - Scripting & Development: Write and test data processing scripts using...

  • Big Data Engineer

    6 days ago

    Mumbai, Maharashtra, India Infogain Full time US$ 90,000 - US$ 1,20,000 per year

    Roles & Responsibilities3 to 5 years of experience in Data Engineering.Hands-on experience with Azure data tools: ADF, Data Lake, Synapse, Databricks.Strong programming skills in SQL and PythonGood understanding of Big Data frameworksKnowledge of data modeling, warehousing, and performance tuning.Familiarity with CI/CD, version control (Git), and Agile/Scrum...

  • Big Data Engineer

    2 days ago

    Mumbai, Maharashtra, India RiskInsight Consulting Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Data Engineer

    4 days ago

    Mumbai, Maharashtra, India WeAssemble Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : Job Summary : We are looking for an experienced Big Data Engineer to design, build, and optimize data pipelines and infrastructure supporting large-scale data processing and analytics. You will be instrumental in migrating our legacy systems to a modern, scalable data platform.Key Responsibilities : - ETL/ELT Pipeline Development:...

  • Big Data Developer

    1 week ago

    Mumbai, Maharashtra, India Progriz Coe Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    ,On-site,,Job Title: Training & Mentorship Specialist Big Data & Cloud TechnologiesLocation: Onsite Lower Parel MumbaiEmployment Type: Full-time Role Overview:We are seeking a highly skilled Big Data & Cloud Technologies Training & Mentorship Specialist to design, deliver, and mentor teams on cutting-edge data engineering, analytics, and cloud practices....

  • Big Data Trainer

    2 weeks ago

    Mumbai, India Medhavart System Full time

    **Required Trainer for Big Data** **Mode of work** : Online, work from home Schedule : Flexible schedule, part time at off-office hours Required trainers to train on Big data technology for a corporate batch of freshers hired by an IT major. **Job Types**: Full-time, Contractual / Temporary Contract length: 12 months **Salary**: ₹100,000.00 -...