Big Data Engineer
22 hours ago
Role: Big Data Engineer
Experience: 7+ Years
Location: Bangalore
Notice: Immediate Joiners Only
Job Description:
Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big Data
Optional Skills: Airflow, Python
Roles & Responsibilities
Overall, 12 years of experience in IT industry, including 5 years in Big Data
At least 3 years of experience in Azure handling Big Data projects.
At least 1 year in event streaming using Kafka.
Hands on with Scala and Java programming, Spark framework, performance optimization
Experience in building reusable frameworks with high quality
Worked on CI/CD (Azure DevOps, GitHub), aware of best practices, code quality and branching strategies.
Ability to automate tasks and deploy production standard code (with unit testing, continuous integration, versioning etc.)
Load transformed data into storage and reporting structures in destinations including data warehouse, high speed indexes, real-time reporting systems and analytics applications.
Peer reviews, Unit testing, deployment to production.
Strong problem solving and logical reasoning ability.
Excellent understanding of all aspects of the Software Development Lifecycle.
Enthusiastic to learn new skills, apply the knowledge on the project.
Ability to work independently at client locations, client facing role.
-
Big Data Engineer
5 days ago
Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per yearWe are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per yearWe're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India The IT Firm Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearBigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...
-
Big Data Engineer
1 day ago
Bengaluru, Karnataka, India Deqode Full time ₹ 5,00,000 - ₹ 25,00,000 per yearBig Data Engineer Tech Stack: Python, Hive & Apache Spark Java & Advanced SQL Hadoop & Big Data Ecosystem Apache Airflow & ETL Pipelines Docker & Containerization Data Modelling & Warehousing Experience- 5 years Share your updated resume now.
-
Big Data Engineer
3 days ago
Bengaluru, Karnataka, India Brillio Full time ₹ 6,00,000 - ₹ 18,00,000 per yearKey skills - Hive, SQL, Python, Spark, Hadoop and kafka , apache airflowJob Title Big Data EngineerRole OverviewWe are seeking a highly skilled Big Data Engineer to join our team. The ideal candidate will have strong experience in building, maintaining, and optimizing large-scale data pipelines and distributed data processing systems. This role involves...
-
Data Engineer
6 days ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAs a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Nagarro Softwares Pvt. Ltd Full time ₹ 6,00,000 - ₹ 18,00,000 per yearAssociate Staff Engineer, Big Data Engineer (LookML & Looker Studio Pro) Company Description We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Big Data Engineer – Spark
1 week ago
Bengaluru, Karnataka, India POWER IT SERVICES Full time ₹ 6,00,000 - ₹ 12,00,000 per yearBig Data Engineer – Spark & AnalyticsLocation- ( Bangalore, Maharashtra)Job Description•Gather operational intel on business processes and policies from multiple sources•Prepare periodical and ad-hoc reports using operational data•Develop semantic core to align data with business processes•Support operations team's work streams for data processing,...