Senior Big Data Engineer

4 weeks ago

Chennai, India Luxoft Full time
Project description

We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .

Responsibilities

Choosing the right technologies for our use cases, deploy and operate.

Setting up Data stores structured, semi structured and non-structured.

Secure data at rest via encryption

Implement tool to access securely multiple data sources

Implement solutions to run real-time analytics

Use container technologies

Skills

Must have

6+ years of relevant technology experience

Programming Skills:

Strong proficiency in Java or Scala.

Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.

Big Data & Data Engineering:

Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.

Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.

Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).

Architecture & Infrastructure:

Background in microservices-based architectures and API integrations.

Hands-on expertise with Kubernetes and Docker for containerization and orchestration.

Cloud & DevOps:

Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.

Understanding of data security best practices, including encryption and secure access controls.

Development Practices:

Knowledge of Agile/Scrum methodologies.

Soft Skills:

Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.

Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.

Nice to have

Exposure to data visualization and exploration tools such as Apache Superset is a plus.

Experience with workflow orchestration tools such as Apache Airflow is an advantage.

Familiarity with Unix/Linux environments is beneficial.

Experience with CI/CD pipelines and modern DevOps tools is a plus.

Other

Languages

English: C2 Proficient

Seniority

Senior

Chennai, India

Req. VR-

BigData Development

BCM Industry

04/09/2025

Req. VR-

  • Big data developer

    1 week ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big data developer

    1 week ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big Data Developer

    5 days ago

    Chennai, India IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python)Experience: 5+ YearsLocations: Chennai, Bangalore, GurugramEmployment Type: Full-TimeNotice Period: Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Senior Big Data Python Developer

    4 weeks ago

    Chennai, India Innovatz Global Full time

    Company Description Innovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts,...

  • Big Data Developer

    4 weeks ago

    Chennai, India IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python) Experience: 5+ Years Locations: Chennai, Bangalore, Gurugram Employment Type: Full-Time Notice Period: Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions....

  • Big data developer

    4 weeks ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python) Experience : 5+ Years Locations : Chennai, Bangalore, Gurugram Employment Type : Full-Time Notice Period : Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics...

  • Big Data Developer

    5 days ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python) Experience : 5+ Years Locations : Chennai, Bangalore, Gurugram Employment Type : Full-Time Notice Period : Immediate to 30 Days Preferred Job Summary We are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The...

  • Big Data Developer

    3 weeks ago

    Chennai, India IntraEdge Full time

    Job Title : Senior Big Data Engineer (Python)Experience : 5+ YearsLocations : Chennai, Bangalore, GurugramEmployment Type : Full-TimeNotice Period : Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The...

  • Big Data Developer

    2 weeks ago

    Chennai, India IntraEdge Full time

    Job Title: Senior Big Data Engineer (Python)Experience: 5+ YearsLocations: Chennai, Bangalore, GurugramEmployment Type: Full-TimeNotice Period: Immediate to 30 Days PreferredJob SummaryWe are seeking an experienced Big Data Engineer with strong expertise in Python to design, build, and manage large-scale data pipelines and analytics solutions. The ideal...

  • Big Data Engineer

    5 days ago

    Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...