Senior Big Data Engineer

1 week ago

Chennai, Tamil Nadu, India Luxoft Full time ₹ 20,00,000 - ₹ 25,00,000 per year
Project description

We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .

Responsibilities

Choosing the right technologies for our use cases, deploy and operate.

Setting up Data stores structured, semi structured and non-structured.

Secure data at rest via encryption

Implement tool to access securely multiple data sources

Implement solutions to run real-time analytics

Use container technologies

Skills

Must have

6+ years of relevant technology experience

Programming Skills:

Strong proficiency in Java or Scala.

Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.

Big Data & Data Engineering:

Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.

Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.

Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).

Architecture & Infrastructure:

Background in microservices-based architectures and API integrations.

Hands-on expertise with Kubernetes and Docker for containerization and orchestration.

Cloud & DevOps:

Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.

Understanding of data security best practices, including encryption and secure access controls.

Development Practices:

Knowledge of Agile/Scrum methodologies.

Soft Skills:

Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.

Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.

Nice to have

Exposure to data visualization and exploration tools such as Apache Superset is a plus.

Experience with workflow orchestration tools such as Apache Airflow is an advantage.

Familiarity with Unix/Linux environments is beneficial.

Experience with CI/CD pipelines and modern DevOps tools is a plus.

Other

Languages

English: C2 Proficient

Seniority

Senior

Chennai, India

Req. VR-117033

BigData Development

BCM Industry

04/09/2025

Req. VR-117033

  • Senior Big Data Developer

    1 week ago

    Chennai, Tamil Nadu, India MOURI Tech Foundation Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key ResponsibilitiesDevelop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.Implement ETL/ELT workflows and ensure data...

  • Senior Big Data Python Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Innovatz Global Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionInnovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts, Project...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Impacteers Full time

    Position Overview :We are looking for a skilled and detail-oriented Big Data Engineer to design, develop, and maintain scalable data pipelines and architectures. The role involves working with large datasets, integrating diverse data sources, and ensuring data availability for analytics, machine learning, and business intelligence. The ideal candidate will...

  • Big Data Engineering

    4 weeks ago

    Chennai, Tamil Nadu, India DataHonDo Pte. Ltd. Full time

    Location: Chennai Walk-in Date: 20th September 2025 Joining: Immediate / Within 30 days Employment Type: Full-time / Contract (Open for both)Job Summary:We are hiring skilled and motivated Big Data Engineers with hands-on experience in SQL, Hadoop ecosystem, Spark, Python, and Kubernetes. The ideal candidates will demonstrate a strong learning attitude,...

  • Big Data Engineering

    3 weeks ago

    Chennai, Tamil Nadu, India DataHonDo Pte. Ltd. Full time

     Location: Chennai Walk-in Date: 20th September 2025 Joining: Immediate / Within 30 days Employment Type: Full-time / Contract (Open for both)Job Summary:We are hiring skilled and motivated Big Data Engineers with hands-on experience in SQL, Hadoop ecosystem, Spark, Python, and Kubernetes. The ideal candidates will demonstrate a...

  • Big Data Engineering

    4 days ago

    Chennai, Tamil Nadu, India DataHonDo Pte. Ltd. Full time ₹ 1,20,000 - ₹ 3,60,000 per year

     Location:Chennai Walk-in Date:20th September 2025 Joining:Immediate / Within 30 days Employment Type:Full-time / Contract (Open for both)Job Summary:We are hiring skilled and motivated Big Data Engineers with hands-on experience in SQL,Hadoop ecosystem, Spark, Python, and Kubernetes. The ideal candidates will demonstrate a strong learning...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Big Data Lead Engineer

    4 days ago

    Chennai, Tamil Nadu, India Synechron Full time ₹ 1,20,000 - ₹ 3,00,000 per year

    Big Data Lead Engineer - Hadoop - Spark & GCP (BigQuery/DataProc) with Java & Python ExpertiseJob SummarySynechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutionsThis full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    The Data Engineer is accountable for developing high quality data products to support theBank's regulatory requirements and data driven decision making. A Data Engineer will serveas an example to other team members, work closely with customers, and remove orescalate roadblocks. By applying their knowledge of data architecture standards, datawarehousing, data...

  • Big Data Lead Engineer

    4 days ago

    Chennai, Tamil Nadu, India Synechron Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Lead Engineer — Hadoop, Spark & GCP (BigQuery/DataProc) with Java & Python Expertise Job Summary Synechron is seeking an experienced Big Data Lead Engineer to drive the design, development, and management of large-scale data solutions. This full-time leadership role involves guiding a team of data engineers and architects to deliver scalable,...