
Big Data Engineer
4 weeks ago
Job Title: Big Data Engineer – Scala
Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.
Experience: 7–10 Years (Minimum 3+ years in Scala)
Notice Period: Immediate to 30 Days
Mode of Work: Hybrid
Click the link below to learn more about the role and take the AI Interview to begin your application journey: https://sl1nk.com/XiPeN
Role Overview
We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.
Key Responsibilities
- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
- Collaborate with cross-functional teams to design scalable cloud-based data architectures.
- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
- Build monitoring and alerting systems leveraging Splunk or equivalent tools.
- Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
- Contribute to product development with a focus on scalability, maintainability, and performance.
Mandatory Skills
- Scala – Minimum 3+ years of hands-on experience.
- Strong expertise in Spark (PySpark) and Python.
- Hands-on experience with Apache Kafka.
- Knowledge of NiFi / Airflow for orchestration.
- Strong experience in Distributed Data Systems (5+ years).
- Proficiency in SQL and query optimization.
- Good understanding of Cloud Architecture.
Preferred Skills
- Exposure to messaging technologies like Apache Kafka or equivalent.
- Experience in designing intuitive, responsive UIs for data analytics visualization.
- Familiarity with Splunk or other monitoring/alerting solutions.
- Hands-on experience with CI/CD tools (Git, Jenkins).
- Strong grasp of software engineering concepts, data modeling, and optimization techniques.
-
Staff Data Engineer
3 weeks ago
Thoothukudi, Tamil Nadu, India Commonwealth Bank Full timeOrganization:At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy...
-
Data Engineer L3
3 weeks ago
Thoothukudi, Tamil Nadu, India Costco IT Full timeAbout Costco Wholesale Costco Wholesale is a multi-billion-dollar global retailer with warehouse club operations in eleven countries. They provide a wide selection of quality merchandise, plus the convenience of specialty departments and exclusive member services, all designed to make shopping a pleasurable experience for their members.About Costco Wholesale...
-
Data Platform Engineer
3 weeks ago
Thoothukudi, Tamil Nadu, India Tekgence Inc Full timeData Platform Engineer Work Location will be Hybrid in Mumbaicontract duration: 12+ monthsStrong Software Engineering SkillsSolid programming expertise, especially in Python, with strong fundamentals in computer science, data structures, algorithms, and system design.Proven problem-solving ability with a focus on writing clean, maintainable, and efficient...
-
Senior AI Engineer
3 weeks ago
Thoothukudi, Tamil Nadu, India ValueMomentum Full timeAbout the jobWe are seeking an experienced AI/NLP Engineer to join our team. The ideal candidate will have expertise in working with large language models and AI-based tools, strong analytical skills, and experience developing, testing, and refining AI-driven applications.Know your team ("Legacy Rewired, Engineering the Future")At ValueMomentum's Engineering...
-
Machine Learning Engineer
4 weeks ago
Thoothukudi, Tamil Nadu, India People Prime Worldwide Full timeAbout Company :They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what's now to what's next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society.About...
-
Freelance Data Engineer – Python, SQL, AWS
4 weeks ago
Thoothukudi, Tamil Nadu, India ThreatXIntel Full timeCompany DescriptionThreatXIntel is a startup cyber security company that offers customized, affordable solutions to protect businesses and organizations from cyber threats. The company provides services like cloud security, web and mobile security testing, and DevSecOps. ThreatXIntel takes a proactive approach to security by continuously monitoring and...
-
Analytic Engineer
2 weeks ago
Thoothukudi, Tamil Nadu, India APPIT Software Inc Full timeKey Responsibilities:Design, build, and maintain scalable and reusable data models using tools like dbt (Data Build Tool).Collaborate with data engineers to ingest and transform data from various sources.Ensure data quality, consistency, and documentation across all datasets.Work closely with analysts and business teams to understand data needs and deliver...
-
Marketing Data Analyst
4 weeks ago
Thoothukudi, Tamil Nadu, India The House of Abhinandan Lodha Full timeWe are seeking a detail-oriented Marketing Data Analyst to join our team in Mumbai. The role requires strong analytical skills to interpret marketing data, derive insights, and support data-driven decision-making for business growth. The ideal candidate will collaborate with the marketing and product teams to measure performance, optimize campaigns, and...
-
Senior AI Engineer – Product
3 weeks ago
Thoothukudi, Tamil Nadu, India Alpinum Consulting Full timeLocation: Flexible / RemoteJob Type: Full-time (permanent or contract)Experience Level: Senior (6+ years engineering, 3+ years Python and data analytics, or AI) RAG pipeline, Agentic AIJob OverviewWe are seeking an experienced AI Engineer to design, develop, and deploy AI solutions that enhance product development workflows, engineering services, and...
-
Software Engineer in Test
4 weeks ago
Thoothukudi, Tamil Nadu, India Staffingine LLC Full timeSDET Engineer / Software Engineer in TestIndia – Remote2 PositionsContract / Full TimeJob SummaryThe SDET Engineer will be responsible for building and maintaining automation test suites using Java, Selenium, and Rest-Assured frameworks. The role involves driving automation-led quality initiatives across releases, defining robust test data strategies, and...