Senior Big Data Engineer

2 days ago

Bengaluru, Karnataka, India Luxoft Full time ₹ 12,00,000 - ₹ 36,00,000 per year
Project description

We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .

Responsibilities

Choosing the right technologies for our use cases, deploy and operate.

Setting up Data stores structured, semi structured and non-structured.

Secure data at rest via encryption

Implement tool to access securely multiple data sources

Implement solutions to run real-time analytics

Use container technologies

Skills

Must have

6+ years of relevant technology experience

Programming Skills:

Strong proficiency in Java or Scala.

Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.

Big Data & Data Engineering:

Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.

Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.

Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).

Architecture & Infrastructure:

Background in microservices-based architectures and API integrations.

Hands-on expertise with Kubernetes and Docker for containerization and orchestration.

Cloud & DevOps:

Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.

Understanding of data security best practices, including encryption and secure access controls.

Development Practices:

Knowledge of Agile/Scrum methodologies.

Soft Skills:

Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.

Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.

Nice to have

Exposure to data visualization and exploration tools such as Apache Superset is a plus.

Experience with workflow orchestration tools such as Apache Airflow is an advantage.

Familiarity with Unix/Linux environments is beneficial.

Experience with CI/CD pipelines and modern DevOps tools is a plus.

Other

Languages

English: C2 Proficient

Seniority

Senior

Bengaluru, India

Req. VR-117033

BigData Development

BCM Industry

04/09/2025

Req. VR-117033

  • Big Data Engineers/Senior Engineers

    2 weeks ago

    Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...

  • Senior Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Guide&Bridge Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Big Data EngineerExperience Required: 3+ YearsAbout the RoleWe are looking for an experiencedSenior Big Data Engineerto design, build, and optimize large-scale data pipelines and platforms. The ideal candidate will have strong expertise in distributed data processing, cloud-based data solutions, and a proven ability to work with complex...

  • Senior Big Data Engineer

    7 days ago

    Bengaluru, Karnataka, India SK HR SERVICES AND ENTERPRISES Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Service Mapping : Application Senior Developer Location : Whitefield, Bangalore Experience : 6 yearsRole Overview : Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key Responsibilities : -...

  • Big Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    BigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India 4Bell Technology Full time

    Job Description :Core Responsibilities :- Design, build, and maintain robust data pipelines (batch or streaming) that process and transform data from diverse sources.- Ensure data quality, reliability, and availability across the pipeline lifecycle.- Collaborate with product managers, architects, and engineering leads to define technical strategy.-...

  • Big Data Engineer

    3 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Description• Gather operational intel on business processes and policies from multiple sources• Prepare periodical and ad-hoc reports using operational data• Develop semantic core to align data with business processes• Support operations team's work streams for data processing, analysis and reporting• Analyse data and Create dashboards for the...

  • Big Data Engineer – Spark

    4 weeks ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & AnalyticsJob Description• Gather operational intel on business processes and policies from multiple sources• Prepare periodical and ad-hoc reports using operational data• Develop semantic core to align data with business processes• Support operations team's work streams for data processing, analysis and reporting•...

  • Big Data Engineer – Spark

    4 weeks ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time

    Big Data Engineer – Spark & Analytics Job Description • Gather operational intel on business processes and policies from multiple sources • Prepare periodical and ad-hoc reports using operational data • Develop semantic core to align data with business processes • Support operations team's work streams for data processing, analysis and reporting...

  • Big Data Engineer – Spark

    3 days ago

    Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big Data Engineer – Spark & AnalyticsLocation- ( Bangalore, Maharashtra)Job Description•Gather operational intel on business processes and policies from multiple sources•Prepare periodical and ad-hoc reports using operational data•Develop semantic core to align data with business processes•Support operations team's work streams for data processing,...

  • Big Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...