Big Data Engineer – Spark
2 days ago
Big Data Engineer – Spark & Analytics
Location
- ( Bangalore, Maharashtra)
Job Description
•Gather operational intel on business processes and policies from multiple sources
•Prepare periodical and ad-hoc reports using operational data
•Develop semantic core to align data with business processes
•Support operations team's work streams for data processing, analysis and reporting
•Analyse data and Create dashboards for the senior management
•Design and implement optimal processes
Regression testing of the releases
•Big Data: Spark, Hive, Data Bricks
•Language: SQL, JAVA/Python
•BI & Analytics: Power BI (DAX), Tableau, Dataiku
•Operating System: Unix
•Experience with Data Migration, Data Engineering, Data Analysis
•Big Data: SCALA, HADOOP
•Tools: DB Visualizer, JIRA, GIT, Bitbucket, Control-M
•Strong problem-solving skills and the ability to work independently and in a team environment.
•Excellent communication skills and the ability to work effectively with cross-functional teams.
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Deqode Full time ₹ 12,00,000 - ₹ 24,00,000 per yearProfile: Big Data Engineer (System Design)Experience:5+ yearsLocation:BangaloreWork Mode:HybridAbout The RoleWe're looking for an experiencedBig Data Engineerwith system design expertise to architect and build scalable data pipelines and optimize big data solutions.Key ResponsibilitiesDesign, develop, and maintain data pipelines and ETL processes using...
-
Big Data Engineer
7 days ago
Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Big Data Engineer – Spark, Kafka
2 days ago
Bengaluru, Karnataka, India LTIMindtree Full timeJob description:Your Experience5 years of experience in large scale realtime stream processing using Apache Spark with messaging infrastructure like KafkaPulsar7 years of experience on Data Pipeline development ETL and processing of structured and unstructured data5 years of experience using NoSQL systems like MongoDB DynamoDB and SnowFlake AthenaExperience...
-
Big Data Engineer
2 days ago
Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearBigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...
-
Big Data Hadoop, Spark and Scala
1 week ago
Bengaluru, Karnataka, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearTCS is looking for Big Data and Hadoop EcosystemsExperience: years OnlyEducation: Minimum 15 years of full time education (10th, 12th and Graduation)Location: BangaloreNotice Period: 0 to 30 DaysRole & responsibilities1 Develop Spark and SCALA code as per requirement.2 Build efficient and optimized ETLs for data ingestion/transformations.3 Should be able to...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Techno Comp Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJOB RESPONSIBILITY· Experience with Big Data technologies will be a plus (Hadoop, Spark, Kafka, HBase, etc)· Write SQL queries to validate the dashboard output· Working experience with database environment - understanding relational database structure and hands-on SQL knowledge to extract/manipulate data for variance testing.· Performing code reviews and...
-
Big Data Engineers/Senior Engineers
2 weeks ago
Bengaluru, Karnataka, India Peoplelogic Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole: Big Data Engineers/Senior Engineers About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background inbuilding and supporting big data solutions. The ideal candidate will have expertise in big datatechnologies, data pipeline development, and performance optimization within a collaborativeand agile...
-
Big Data Engineer
2 days ago
Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per yearWe're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...
-
Big Data Developer
2 days ago
Bengaluru, Karnataka, India LION AND ELEPHANTS Full time ₹ 20,00,000 - ₹ 25,00,000 per yearJob Description:We are looking for skilled Big Data Engineers using Java Spark with 5-10 years of experience in Big Data / legacy platforms, who can join immediately. We have openings in Bengaluru, Chennai, Hyderabad, Pune, Delhi.Desired candidates should have design, development and optimization of real-time & batch data pipelines experience in a Big Data...
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...