Senior Big Data Engineer

5 days ago

Chennai, Tamil Nadu, India Luxoft Full time US$ 1,04,000 - US$ 1,30,878 per year
Project description

We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .

Responsibilities

Choosing the right technologies for our use cases, deploy and operate.

Setting up Data stores structured, semi structured and non-structured.

Secure data at rest via encryption

Implement tool to access securely multiple data sources

Implement solutions to run real-time analytics

Use container technologies

Skills

Must have

6+ years of relevant technology experience

Programming Skills:

Strong proficiency in Java or Scala.

Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.

Big Data & Data Engineering:

Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.

Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.

Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).

Architecture & Infrastructure:

Background in microservices-based architectures and API integrations.

Hands-on expertise with Kubernetes and Docker for containerization and orchestration.

Cloud & DevOps:

Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.

Understanding of data security best practices, including encryption and secure access controls.

Development Practices:

Knowledge of Agile/Scrum methodologies.

Soft Skills:

Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.

Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.

Nice to have

Exposure to data visualization and exploration tools such as Apache Superset is a plus.

Experience with workflow orchestration tools such as Apache Airflow is an advantage.

Familiarity with Unix/Linux environments is beneficial.

Experience with CI/CD pipelines and modern DevOps tools is a plus.

Other

Languages

English: C2 Proficient

Seniority

Senior

Chennai, India

Req. VR-117033

BigData Development

BCM Industry

04/09/2025

Req. VR-117033

  • Big Data Engineering Lead

    3 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to lead our data engineering team and drive the development of scalable, secure, and high-performance big data solutions.Experience in leading distributed teams across multiple geographies and time zones is essential.Strong technical expertise in Scala, Python, Apache Spark...

  • Senior Big Data Engineer

    15 hours ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job OverviewSummary of the Role:As a senior data engineering professional, you will play a crucial role in designing, developing, and maintaining large-scale data processing systems. This is an excellent opportunity to utilize your technical expertise in Big Data technologies and work closely with cross-functional teams to drive business growth through...

  • Senior Big Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Platform EngineerAt our organization, we are building a world-class big data platform to bring value out of data for us and for our customers.We aim to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.Our mission is to build scalable, available,...

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeBigDataEngineer Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...

  • Senior Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India Eucloid Data Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    About The Role:Eucloid is looking for a senior Data Engineer with hands-on expertise in Databricks to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream...

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...

  • Big Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Amazon Full time

    Profit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation data and Business...

  • Big Data Engineering Leader

    1 week ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled professional to lead our data engineering initiatives. As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems.Key Responsibilities:Design and implement scalable data pipelines using PySpark and HiveDevelop and maintain big data applications using Spark, HBase, and DQ...

  • Senior Big Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 50,00,000

    Big Data Professional RoleThe ideal candidate will be a skilled data engineer with strong expertise in SQL and a deep understanding of big data from a technical perspective. The role requires proficiency in working with JSON structures, REST APIs, and the ability to interpret application code from legacy systems.Key ResponsibilitiesDevelop, optimize, and...