Senior Big Data Engineer
4 days ago
We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .
ResponsibilitiesChoosing the right technologies for our use cases, deploy and operate.
Setting up Data stores structured, semi structured and non-structured.
Secure data at rest via encryption
Implement tool to access securely multiple data sources
Implement solutions to run real-time analytics
Use container technologies
SkillsMust have
6+ years of relevant technology experience
Programming Skills:
Strong proficiency in Java or Scala.
Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.
Big Data & Data Engineering:
Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.
Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.
Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).
Architecture & Infrastructure:
Background in microservices-based architectures and API integrations.
Hands-on expertise with Kubernetes and Docker for containerization and orchestration.
Cloud & DevOps:
Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.
Understanding of data security best practices, including encryption and secure access controls.
Development Practices:
Knowledge of Agile/Scrum methodologies.
Soft Skills:
Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.
Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.
Nice to have
Exposure to data visualization and exploration tools such as Apache Superset is a plus.
Experience with workflow orchestration tools such as Apache Airflow is an advantage.
Familiarity with Unix/Linux environments is beneficial.
Experience with CI/CD pipelines and modern DevOps tools is a plus.
OtherLanguages
English: C2 Proficient
Seniority
Senior
Bengaluru, India
Req. VR-117033
BigData Development
BCM Industry
04/09/2025
Req. VR-117033
-
Senior Big Data Engineer
1 week ago
Bengaluru, Karnataka, India SK HR SERVICES AND ENTERPRISES Full time ₹ 20,00,000 - ₹ 25,00,000 per yearService Mapping : Application Senior Developer Location : Whitefield, Bangalore Experience : 6 yearsRole Overview : Looking for a Senior Big Data Developer to design, build, and optimize data pipelines and analytics solutions. Candidates with prior exposure to the Ericsson Wallet Platform will be given preference.Key Responsibilities : -...
-
Big Data Engineer
4 days ago
Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearBigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...
-
Senior Big Data Developer
2 weeks ago
Bengaluru, Karnataka, India Info Origin Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearNEW OPPORTUNITY || IMMEDIATE TO 30 DAYS JOINERS REQUIRED || SENIOR BIG DATA DEVELOPER ||Job Title: Senior Big Data DeveloperRequired Experience: 6+ YearsLocation: BangaloreEmployment Type: Full-timeJob SummaryKey Responsibilities· Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase.· Implement ETL/ELT workflows...
-
Big Data Engineer – Spark
4 days ago
Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 6,00,000 - ₹ 12,00,000 per yearBig Data Engineer – Spark & AnalyticsLocation- ( Bangalore, Maharashtra)Job Description•Gather operational intel on business processes and policies from multiple sources•Prepare periodical and ad-hoc reports using operational data•Develop semantic core to align data with business processes•Support operations team's work streams for data processing,...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Senior Big Data Developer
4 days ago
Bengaluru, Karnataka, India INFO ORIGIN TECHNOLOGIES PRIVATE LIMITED Full timeJob Title : Senior Big Data Developer.Required Experience : 6 Years.Location : Bangalore.Employment Type : Full-time.Job Summary :Key Responsibilities : - Develop, test, and deploy high-performance data pipelines using Hadoop, Spark, Kudu, and HBase. - Implement ETL/ELT workflows and ensure data integrity and scalability. - Work closely...
-
Senior Big Data Engineer
7 days ago
Bengaluru, Karnataka, India Allstate Insurance Full time ₹ 20,00,000 - ₹ 25,00,000 per yearAt Allstate, great things happen when our people work together to protect families and their belongings from life's uncertainties. And for more than 90 years our innovative drive has kept us a step ahead of our customers' evolving needs. From advocating for seat belts, air bags and graduated driving laws, to being an industry leader in pricing...
-
Big Data Engineer
4 days ago
Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per yearWe're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...
-
Big Data Engineer
4 days ago
Bengaluru, Karnataka, India The IT Firm Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProfile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...