Big Data Engineer

1 day ago

Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Responsibilities
  • Design, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases.
  • Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis.
  • Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them into technical solutions.
  • Ensure data quality and integrity through effective validation, monitoring, and troubleshooting techniques.
  • Optimize data processing workflows for maximum performance and efficiency.
  • Stay up-to-date with evolving Big Data technologies and methodologies to enhance existing systems.
  • Implement best practices for data governance, security, and compliance.
  • Document technical designs, processes, and procedures to support knowledge sharing across teams.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 4+ years of experience as a Big Data Engineer or in a similar role.
  • Strong proficiency in Big Data technologies (Hadoop, Spark, Hive, Pig) and frameworks.
  • Extensive experience with programming languages such as Python, Scala, or Java.
  • Knowledge of data modeling and data warehousing concepts.
  • Familiarity with NoSQL databases like Cassandra or MongoDB.
  • Proficient in SQL for data querying and analysis.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration abilities.
  • Ability to work independently and effectively in a fast-paced environment.

Benefits

Competitive salary and benefits package.

Opportunity to work on cutting-edge technologies and solve complex challenges.

Dynamic and collaborative work environment with opportunities for growth and career advancement.

Regular training and professional development opportunities.

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    We are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Profile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Key skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Innova ESI Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data EngineerExperience: 7+ YearsLocation: BangaloreNotice: Immediate Joiners OnlyJob Description:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, 12 years of experience in IT industry, including 5 years in...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Adobe Full time ₹ 20,00,000 - ₹ 40,00,000 per year

    Our CompanyChanging the world through digital experiences is what Adobe's all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact...

  • Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Location – Pune/ChennaiExp - 6 to 9RequirementsTechnology: - Big Data (Hadoop, Hive, Spark, Scala, PLSQL/ No SQL Database)Knowledge/Experience (Must):· 6-9 years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and eventbased messaging.· Relational and NoSQL database integration...

  • Big Data Engineer

    1 day ago

    Bengaluru, Karnataka, India Coforge Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Hiring Now: Big Data Engineer Bangalore || Coforge LtdNote: This position requires 5 days mandatory - Work From Office.Send your updated CV to: For queries, reach out on WhatsApp: Job Location: BangaloreExperience Required: 6 YearsAvailability: Immediate Joiners PreferredKey Technologies & Skills Required:Big Data Tools: Hadoop, HiveProgramming Languages:...

  • Senior Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Allstate Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    At Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing...

  • Big Data/Hadoop Engineer

    3 days ago

    Bengaluru, Karnataka, India Rackspace Technology Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are hiring for Big Data / Hadoop EngineerExp - 3+yrsLocation - Bangalore ( 3days WFO)Notice Period - Less than 30days only. Big Data Development: Design, build, and maintain robust and scalable data pipelines for ETL/ELT processes using tools within the Hadoop ecosystem.. Programming & Scripting: Develop complex data processing applications using Spark...