Data Engineer

21 hours ago

Davangere, Karnataka, India Impetus Career Consultants Full time

HIRING FOR A USA BASED MNC -

Location - Chennai

Experience : 3-10years

Data Engineer T3

  • Bachelor's or master's degree with 3+ years of experience in Computer Science, Data Science, Engineering, or a related field.
  • 3+ years of experience in working with Python, SQL, PySpark and bash scripts. Proficient in software development lifecycle and software engineering practices.
  • 3+ years of experience in developing and maintaining robust data pipelines for both structured and unstructured data to be used by Data Scientists to build ML Models.
  • 3+ years of experience working with Cloud Data Warehousing (Redshift, Snowflake, Databricks SQL or equivalent) platforms and experience in working with distributed frameworks like Spark.
  • 2+ years of hands-on experience in using Databricks platform for data engineering. Detailed knowledge of Delta Lake, Databricks Workflow, Job Clusters, Databricks CLI, Databricks Workspace etc.
  • Solid understanding of machine learning life cycle, data mining, and ETL techniques.
  • Familiarity with commonly used machine learning libraries (like scikit-learn, xgboost) in terms of exposure and handling of code base which makes use of these libraries for model training & scoring.
  • Proficiency in understanding of REST APIs, experience in using different types of APIs to either extract data or perform a functionality exposed by APIs.
  • Familiarity in Pythonic API development frameworks like Flask / FastAPI. Experience in using containerization frameworks like Docker / Kubernetes.
  • Hands-on experience in building and maintaining tools and libraries which have been used by multiple teams across organization. e.g. Creating Data Engineering common utility libraries, DQ Libraries etc.
  • Proficient in understanding and incorporating software engineering principles in design & development process.
  • Hands on experience with using CI/CD tools (e.g., Jenkins or equivalent), version control (Github, Bitbucket), Orchestration (Airflow, Prefect or equivalent)
  • Excellent communication skills and ability to work and collaborate with cross functional teams across technology and business.

  • aws data engineer

    5 days ago

    Davangere, Karnataka, India AS Technology Corporation Full time

    Job Description:Data Engineer with experience in digital channel activities, data engineering, and cloud technologies, particularly in AWS. This is an exciting opportunity to work on a project with a focus on integrating and processing channel activity data from multiple sources, including Terradata, and Hadoop environments. The ideal candidate will possess...

  • Lead Data Engineer

    2 weeks ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeadThis role is responsible for overseeing the development and implementation of data engineering solutions.Main Responsibilities:Develop and maintain data architectures to ensure scalability, security, and alignment with business objectives.Collaborate with cross-functional teams to design and implement data pipelines,...

  • Data Engineering Expert

    7 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data EngineerExpertise in building scalable data pipelines and deploying machine learning models is required.Key Responsibilities:Design, develop and implement data pipelines to transform raw data into actionable insights.Develop and train ML models using Python.Collaborate with engineers to integrate model outputs into production...

  • Data Engineering Lead

    23 hours ago

    Davangere, Karnataka, India beBeeLeadership Full time ₹ 18,00,000 - ₹ 25,00,000

    Big Data EngineerWe're seeking a seasoned professional to spearhead our Big Data initiatives. This role is ideal for an engineer who excels in high-pressure environments and thrives on mentoring junior talent.Main Responsibilities:Lead hands-on Big Data development, including coding, testing, troubleshooting, and deployment.Support ongoing projects,...

  • Principal Data Engineer

    2 weeks ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job SummaryThis is a unique opportunity for a skilled Data Engineer to join our organization and play a key role in driving business growth through data-driven insights.The ideal candidate will have a strong background in designing and developing scalable data pipelines, as well as experience with cloud-based data services and big data processing...

  • Data Engineer Leader

    5 days ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,01,00,000

    Job Title: Data Engineer LeaderWe are seeking a seasoned Senior Data Engineer to join our team.The ideal candidate will have 5+ years of experience in data engineering, with a strong background in Azure and AWS Databricks. Expertise in Python, Scala, Spark, Pyspark, HIVE, HBase, Impala, and Parquet is required.Strong SQL and RDBMS skills, as well as...

  • Data Engineering Lead

    24 hours ago

    Davangere, Karnataka, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Our data engineering team is seeking a highly skilled and experienced professional to join our ranks.Job DescriptionWe are looking for a talented Senior Data Engineer to design and implement large-scale lakehouse architectures, unifying data lakes and warehouses. This individual will be responsible for developing and optimizing streaming pipelines using...

  • Lead Data Engineer

    5 days ago

    Davangere, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Azure Data Engineering Lead PositionOverview:We seek a skilled and experienced Azure Data Engineer to lead our team in data pipeline development and management.Key Responsibilities:Our ideal candidate will have hands-on expertise in designing, developing, and optimizing data pipelines using Azure and Databricks. They will also work with Databricks...

  • Scalable Data Engineer

    1 week ago

    Davangere, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Scalable Data EngineerLocation: Multiple LocationsExperience: 7–10 Years (Minimum 3+ years in Scala)Notice Period: Immediate to 30 DaysMode of Work: Hybrid We are looking for a highly skilled data engineer with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a...

  • Senior Data Engineer

    3 days ago

    Davangere, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock Career Growth as a Senior Data EngineerYou will play a pivotal role in driving innovation and delivering cutting-edge data solutions that establish our IT department as a core competitive advantage.Key Responsibilities:Design, implement, and oversee the deployment of scalable, reliable, and secure data infrastructure, ensuring seamless integration...