Senior Data Engineer

1 month ago


Anantapur, India Digile Full time

Job Description:


6-10 years of overall experience mainly in the data engineering space building data ingestion and transformation pipelines.

  • Design and implement data pipelines using best practices and industry-leading tools like Databricks and Azure Data Factory (ADF)
  • Extract, transform, and load large datasets from various sources, ensuring data quality and integrity
  • Utilize Python and Spark to perform complex data manipulations and aggregations
  • Integrate data pipelines with APIs and external systems using efficient methods
  • Experience in Cleansing and Azure Data Explorer workflows
  • Monitor and maintain data pipelines, ensuring smooth operation and identifying potential issues
  • Collaborate with data scientists, analysts, and engineers to understand data needs and deliver valuable insights
  • Must have implementation experience of Azure based cloud Data project/program as solution architect.
  • Expert level knowledge on Spark. Extensive hands-on experience working with data using SQL, Python, Java, Scala
  • Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms. (Both Cloud and On-Premise)
  • Excellent communications skills with the ability to clearly present ideas, concepts, and solutions
  • Bonus points if you have experience on Insurance Domain for data engineering project.
  • Strong attention to detail and accuracy, knowledge of data quality frameworks and standards, experience with data profiling and data analysis tools, understanding of data management best practices and excellent communication and collaboration skills.


  • Senior Data Engineer

    1 month ago


    Anantapur, India HCLTech Full time

    Position: Senior Data EngineerExperience: 5 to 10 YearsLocation: NagpurRequired Skills Set:Experience in Google Cloud Platform (GBQ, GCS, Kubernetes POD operator and Image creation, Composer, DAG creation)Experience in Python Programming (Pandas, Py Spark, Airflow)Experience in Big Data, Data Integration, Data Pipeline, Data Ingestion, (ELT/ETL),...


  • Anantapur, India HCLTech Full time

    Senior Data engineersJob description: Looking for skilled Sr. Data Engineers to design and implement data solutions supporting Marketing, Sales, and Customer Service areas. The ideal candidate will have experience with DBT, Snowflake, Python and Azure, along with a strong foundation Big Data, and Cloud Platforms. You will be responsible for working on...

  • Senior Data Scientist

    1 month ago


    Anantapur, India ICICI Lombard General Insurance Company Limited Full time

    Job Title - Senior Data Scientist with 3-8 years of work experience.Qualification -Tier-I with Masters in statistics, mathematics, economics, or Bachelors in Engineering with a bent towards analytics/statisticsSkills/ Experience:Ability to engage with stakeholders to understand business requirements and convert the same into technical problems for solution...


  • Anantapur, India Info Services Full time

    we are looking for people who have developed and operated Airflow—not just used airflow to orchestrate data ResponsibilitiesBe a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations.Build tools and services...

  • Senior Data Analyst

    1 week ago


    Anantapur, India Capital Numbers Full time

    Roles and Responsibilities:Develop efficient data ingestion pipelines to collect data from various sources (databases, APIs, files)Ensure data quality and integrity throughout the ingestion processData Transformation and NormalizationDesign and implement data transformation logic to normalize and structure data for analysisCreate data models and schemas that...

  • Data Scientist

    5 months ago


    Anantapur, India Episeio business solutions Full time

    Who we are: - Technical team: A team full of data scientists, data engineers and business analysts who work with 1M+ data points every day. - Market Size: Massive multi-billion $ global market opportunity. - Leadership: Combined experience of 40+ years of experience in the industry - Customers: Word-of-mouth and referral driven marketing to acquire...


  • Anantapur, India KJBN Labs Full time

    Job Profile: Senior/ Software Engineer - Frontend (Flutter)We seek a skilled and enthusiastic Software Engineer - Frontend (Flutter) to join our team. The ideal candidate will have experience building responsive and high-performance mobile applications using Flutter and Dart, with a strong focus on modern front-end development practices. As a Flutter...


  • Anantapur, Andhra Pradesh, India Marsh McLennan Full time

    About the Role:As a Senior Specialist at Marsh McLennan, you will play a critical role in supporting the company's decision-making processes by providing data-driven insights and recommendations. Your responsibilities include analyzing complex data sets, identifying trends, and communicating findings to key stakeholders. Your insights will inform strategic...


  • Anantapur, India Forage AI Full time

    Senior Data Operations Specialist - Job DescriptionAre you an enthusiastic extrovert with a high passion for performance? Do you enjoy working in teams to achieve a common goal together? Are you a detail-oriented person who enjoys going through datasets to identify unique patterns and catch outliers? Is multitasking one of your strengths? If so, then join...


  • Anantapur, India Claranet Full time

    Role Description: Experience Range: 8-14 yearsMandatory Skills: NSX, FortiGate and F5High level summary of the role including an overview of the job’s main purpose, who the job holder will report to and how the job contributes to the organization’s success. Some information about the department the role sits within would be helpful.Position Summary:The...


  • Anantapur, Andhra Pradesh, India ValueMatrix Jobs Full time

    Senior Product Manager at ValueMatrix.AIJoin our team as a Senior Product Manager at ValueMatrix.AI, where you will play a key role in defining and executing the product strategy, roadmap, and feature prioritization. As a Senior Product Manager, you will work closely with cross-functional teams to deliver high-quality products that meet customer needs.Key...

  • Data Engineer

    3 weeks ago


    Anantapur, India Truelancer.com Full time

    Job Title: Data Engineer (Gen AI)Mandatory Skills: Gen AI, Azure Tech Stack, PythonJD:1. Strong experience in Python programming language - Must.2. Experience in REST APIs, Fast APIs, Graph APIs, SQL Alchemy.3. Good experience in Azure Services like DataLake, Azure SQL, Function App, Azure Cognitive Search.4. Good Understanding on Chunking, Embeddings,...

  • Data Analyst BI

    4 weeks ago


    Anantapur, India Assembly Global Full time

    Role: Data Analyst, BIExp: 2+ YrsLocation: BangaloreWork Mode: HybridNP: Immediate to 60 daysSkill: SQL, Visualization Tools (Tableau, Power BI, Looker), Data Sources, DescriptionWe are Assembly – and we’re not like the rest. We’re the modern alternative agency, bringing together industry-leading data, talent, and tech to Find the Change That Fuels...

  • Data Scientist

    3 weeks ago


    Anantapur, Andhra Pradesh, India 17LIVE Inc. Full time

    About 17LIVE Inc.We are a live streaming company that enables artists to connect with the world anytime, anywhere. Our team helps serve personalized recommendations by making it easy for people to find and join the best streams as they unfold.Job DescriptionWe are seeking a talented Data Scientist to join our team. As a Data Scientist, you will design and...

  • Data Scientist

    3 weeks ago


    Anantapur, Andhra Pradesh, India 17LIVE Inc. Full time

    About 17LIVE Inc.We are a live streaming company that enables artists to connect with the world anytime, anywhere. Our team helps serve personalized recommendations by making it easy for people to find and join the best streams as they unfold.Job DescriptionWe are seeking a talented Data Scientist to join our team. As a Data Scientist, you will design and...


  • Anantapur, Andhra Pradesh, India Exasoft Full time

    Job DescriptionExasoft is seeking a highly skilled Senior Integration Strategist to lead our IVVQ team in Singapore.Key Responsibilities:Develop and implement integration strategies to ensure seamless IVVQ activities.Collaborate with cross-functional teams to establish requirements and perform cost estimates and schedules.Propose and implement IVV scenarios...


  • Anantapur, Andhra Pradesh, India Luxoft Full time

    Project OverviewLuxoft is seeking a highly skilled Cloud Development Lead to join our team and lead the development of a strategic quality control tool in cloud (Azure).The tool aims to improve the quality control process over time by providing a centralized platform for data sourcing, mastering, and storage.The ideal candidate will have experience in...

  • Data Scientist

    3 weeks ago


    Anantapur, Andhra Pradesh, India 17LIVE Inc. Full time

    About 17LIVE Inc.We're a company that enables artists to connect with the world through live streaming. Our mission is to facilitate technology innovation for society, while providing our team members with the freedom to stamp their identity.Job DescriptionWe're seeking a talented individual to join our team as a Data Scientist. As a key member of our...

  • Data Scientist

    3 weeks ago


    Anantapur, Andhra Pradesh, India 17LIVE Inc. Full time

    About 17LIVE Inc.We're a company that enables artists to connect with the world through live streaming. Our mission is to facilitate technology innovation for society, while providing our team members with the freedom to stamp their identity.Job DescriptionWe're seeking a talented individual to join our team as a Data Scientist. As a key member of our...

  • Data Scientist

    3 weeks ago


    Anantapur, Andhra Pradesh, India 17LIVE Inc. Full time

    About 17LIVE Inc.We're a company that enables artists to connect with the world through live streaming. Our mission is to facilitate technology innovation for society, while providing our team members with the freedom to stamp their identity.Job DescriptionWe're seeking a talented individual to join our team as a Data Scientist. As a key member of our...