Big data engineer

3 weeks ago

Anantapur, Andhra Pradesh, India Idyllic Services Full time

Job Title: Big Data Engineer – ScalaLocation: Bangalore, Chennai, Gurgaon, Pune, Mumbai.Experience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid ???? Click the link below to learn more about the role and take the AI Interview to begin your application journey: Pe NRole OverviewWe are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, Ni Fi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.Key Responsibilities- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.- Work extensively with Scala, Spark (Py Spark), and Python for data processing and transformation.- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like Ni Fi / Airflow.- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.- Collaborate with cross-functional teams to design scalable cloud-based data architectures.- Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.- Build monitoring and alerting systems leveraging Splunk or equivalent tools.- Participate in CI/CD workflows using Git, Jenkins, and other Dev Ops tools.- Contribute to product development with a focus on scalability, maintainability, and performance.Mandatory Skills- Scala – Minimum 3+ years of hands-on experience.- Strong expertise in Spark (Py Spark) and Python.- Hands-on experience with Apache Kafka.- Knowledge of Ni Fi / Airflow for orchestration.- Strong experience in Distributed Data Systems (5+ years).- Proficiency in SQL and query optimization.- Good understanding of Cloud Architecture.Preferred Skills- Exposure to messaging technologies like Apache Kafka or equivalent.- Experience in designing intuitive, responsive UIs for data analytics visualization.- Familiarity with Splunk or other monitoring/alerting solutions.- Hands-on experience with CI/CD tools (Git, Jenkins).- Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Data Scientist

    3 weeks ago

    Anantapur, Andhra Pradesh, India Live Connections Full time

    Role: Data Scientist and Gen AIExperience: 3.2yrs - 10 yrsLocation GurugramWork Mode: HybridJob Summary:We are seeking a Data Scientist with proven experience in handling and analyzing large-scale datasets to derive actionable business insights. The ideal candidate will have strong expertise in AI/ML techniques, advanced analytics, and experience working...

  • Cloud Data Engineer With Pl/sql, Sql, Aws, Data Bricks

    2 weeks ago

    Anantapur, Andhra Pradesh, India Blue Cloud Softech Solutions Limited Full time

    About the CompanyAt BCSS we strongly believe that data and analytics are strategic drivers for future success.We are building a world class advanced analytics team that will solve some of the most complex strategic problems and deliver topline growth and operational efficiencies across our business.The Analytics team at BCSS is part of the Organization and...

  • Data engineer

    4 weeks ago

    Anantapur, Andhra Pradesh, India SourceFuse Full time

    Source Fuse Technologies hiring for Data Engineer with 3+ years for experience Job Summary:As a Data Engineer, you'll manage the invisible backbone of our analytics, building scalable data pipelines that fuel real-time insights for 630+ ships worldwide. Your work will turn raw data points into actionable intelligence, propelling machine learning models and...

  • Software Engineer

    6 days ago

    Anantapur, Andhra Pradesh, India Healix Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Exciting things are happening in AnantapurWe're building a next-gen education + health-tech startup with big partnerships in the works. At this stage, I'm looking to connect with ambitious developers / engineers in Anantapur who are hungry to work on challenging problems around personalization, data, and AI.If you're passionate about:• Building scalable...

  • Cloud Data Architect

    2 weeks ago

    Anantapur, Andhra Pradesh, India beBeeData Full time US$ 1,50,000 - US$ 2,50,000

    Invokhr Solutions seeks a key member of the consulting team to help clients re-invent their corporate finance function through advanced analytics.You will work directly with senior stakeholders designing and implementing data strategy in finance, including controllership, FP&A and GPO. You will develop technical solutions to deliver scalable analytical...

  • Data Engineer

    4 weeks ago

    Anantapur, Andhra Pradesh, India Innodata Inc. Full time

    We are looking for a Data Engineer with strong experience in CI/CD practices, Databricks (Spark), Python, Github and SQL. The ideal candidate should have hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.Key ResponsibilitiesDesign, implement, and...

  • Senior Data Engineer

    4 weeks ago

    Anantapur, Andhra Pradesh, India GSONE Technologies Full time

    We are seeking a Senior Data Engineer with 4–5 years of experience, located in Chennai or anywhere within Tamil Nadu, to join our remote-first team. You will be responsible for designing and implementing high-quality, secure, and scalable data pipelines and systems that power reporting, analytics, and operational use cases.This is a remote-first...

  • Azure data engineer

    3 weeks ago

    Anantapur, Andhra Pradesh, India People Prime Worldwide Full time

    Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from...

  • Azure data engineer

    3 weeks ago

    Anantapur, Andhra Pradesh, India LTIMindtree Full time

    Role: Azure Data Bricks DeveloperLocation: Nagpur/Bhubaneshwar/KolkataAbout LTIMindtree: LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more...

  • Data Engineer

    3 weeks ago

    Anantapur, Andhra Pradesh, India Apidel Technologies Full time

    Job Responsibilities: E2E support of Data project Lifecycle (Acquire, Organize, Analyze and Deliver).Define, innovate and shape the architecture for new data products / features.Seeing through a project from conception to finished product.Hands on work on core Data platforms and toolsAnalyze & translate functional specifications /user stories into technical...