Big Data Engineer
2 weeks ago
Job Title : Big Data Engineer - ScalaExperience : 7 to 10Years (Minimum 3+ years in Scala)Notice Period : Immediate to 30 DaysRole Overview : We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.Key Responsibilities : - Design, develop, and optimize large-scale data pipelines and distributed data processing systems.- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.- Collaborate with cross-functional teams to design scalable cloud-based data architectures.- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.- Build monitoring and alerting systems leveraging Splunk or equivalent tools.- Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.- Contribute to product development with a focus on scalability, maintainability, and performance.Mandatory Skills : - Scala - Minimum 3+ years of hands-on experience.- Strong expertise in Spark (PySpark) and Python.- Hands-on experience with Apache Kafka.- Knowledge of NiFi / Airflow for orchestration.- Strong experience in Distributed Data Systems (5+ years).- Proficiency in SQL and query optimization.- Good understanding of Cloud Architecture.Preferred Skills : - Exposure to messaging technologies like Apache Kafka or equivalent.- Experience in designing intuitive, responsive UIs for data analytics visualization.- Familiarity with Splunk or other monitoring/alerting solutions.- Hands-on experience with CI/CD tools (Git, Jenkins).- Strong grasp of software engineering concepts, data modeling, and optimization techniques (ref:hirist.tech)
-
Big Basket
2 weeks ago
Bengaluru, India big basket Full timeWhat would you be doing/ Expected from this role ?- Collaborate with cross-functional teams including data scientists, engineers, and product managers to deliver AI-driven solutions.- Drive the architecture of machine learning pipelines from data collection and preprocessing to model training, evaluation, and deployment.- Implement scalable machine learning...
-
Big Data Engineer
3 days ago
Bengaluru, India Acme Services Full timeJob Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...
-
Big Data Engineer
2 weeks ago
Bengaluru, India Tata Consultancy Services Full timeJob Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Big Data
3 days ago
Bengaluru, India Teamware Solutions Full timeJob Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute...
-
Big Data Engineer
10 hours ago
Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per yearWe are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Reveille Technologies,Inc Full time ₹ 16,00,000 - ₹ 24,00,000 per yearWe're Hiring: Big Data Engineer – Full-TimeLooking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data EngineerGrade: G4 |TSRLocation: Bangalore (Onsite/Hybrid – specify if needed)Budget: ₹13,39,200Experience: 4–6 yearsSkills:Azure Databricks (ADB)PySparkSQLSpark (Scala/Python)TerraformAirflow & KubernetesData Warehousing &...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India The IT Firm Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...
-
Big Data Engineer
6 days ago
Bengaluru, Karnataka, India Fractal Analytics Private Limited Full time ₹ 6,00,000 - ₹ 18,00,000 per yearBigData Engineer It's fun to work in a company where people truly BELIEVE in what they are doing We're committed to bringing passion and customer focus to the business.About the Role:We are seeking highly skilled Big Data Engineers/Senior Engineers with a strong background in building and supporting big data solutions. The ideal candidate will have...
-
Big Data Engineer
2 weeks ago
Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearBig Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...