Data Engineer

3 weeks ago

Mangalore, India YO HR Consultancy Full time

Data Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets.Qualifications· Data Engineering and Data Modeling skills· Experience with Extract Transform Load (ETL) pipelines· Expertise in implementing data warehousing solutions· Analytical skills for performing data analytics on large datasets· Strong programming skills in languages like Python, Java, or Scala· Experience with Big Data and cloud-based technologies like Hadoop, Spark, and AWS· Understanding of data governance and security principles· Bachelor's degree in Computer Science, Information Systems, or related field· Strong communication skills and ability to work independently and collaborativelyExperience Required: 2+ years in Data Engineering or related fieldPrimary Capabilities:SQL Expertise:· Proficiency in writing complex SQL queries.· Experience with database design and optimization.· Ability to perform data manipulation and analysis.Databricks Experience:· Hands-on experience with Databricks platform.· Familiarity with Databricks' integration with various data sources and sinks.· Experience in building and optimizing big data pipelines using Databricks.PySpark Proficiency:· Strong skills in PySpark for large-scale data processing.· Understanding of PySpark's architecture and its application in data processing and transformation tasks.· Ability to write efficient, scalable, and reusable code in PySpark.Python Programming:· Strong programming skills in Python.· Experience with Python libraries relevant to data engineering (e.g., Pandas, NumPy).· Ability to write clean, maintainable, and efficient code in Python.AWS Experience:· Knowledge of AWS services relevant to data engineering (e.g., S3, Lambda, CodeCommit, etc.,).· Knowledge in building and maintaining data infrastructures on AWS.· Understanding of cloud computing concepts and how they apply to data engineering tasks.Analytics Skills:· Ability to derive insights from large datasets.· Knowledge of data visualization tools and techniques.· Proficiency in statistical analysis and using data to inform decisions.Logical Thinking and Problem-Solving:· Strong logical reasoning and analytical skills.· Proven ability to troubleshoot and solve complex problems.· Capacity to break down and simplify complex problems, developing practical, efficient solutions.Other Desirable Qualifications:· Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.· Good communication skills and the ability to work collaboratively in a team.· Experience with version control tools like Git, CodeCommit.· Familiarity with Agile methodologies and DevOps practices.· Certification in relevant technologies (e.g., Databricks, AWS Certified Data Analytics) is a plus

  • Data engineer

    5 days ago

    Mangalore, India Recro Full time

    Key Responsibilities include: Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support:...

  • Data Engineer

    6 days ago

    Mangalore, India Staffingine LLC Full time

    Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3,...

  • Data Engineer

    7 days ago

    Mangalore, India Staffingine LLC Full time

    Data EngineerIndia, RemoteFull Time /Contract# of Positions - 3Job SummaryThe Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as S3,...

  • Data Engineer

    3 days ago

    Mangalore, India BLJ Tech Geeks Full time

    Job Title: Data EngineerCompany - Big4 (PERMANENT)Location: Bangalore (Hybrid)Job Type: Full-timeExperience Level: 5Yrs aboveNotice Period - Serving only till 31st Dec not more than thisAbout the Role:We are looking for a skilled and detail-oriented Data Engineer to join our growing data team. You will be responsible for building and maintaining scalable...

  • Data Engineer

    3 days ago

    Mangalore, India BLJ Tech Geeks Full time

    Job Title: Data EngineerCompany - Big4 (PERMANENT)Location: Bangalore (Hybrid)Job Type: Full-timeExperience Level: 5Yrs aboveNotice Period - Serving only till 31st Dec not more than thisAbout the Role:We are looking for a skilled and detail-oriented Data Engineer to join our growing data team. You will be responsible for building and maintaining scalable...

  • Data Engineer

    4 days ago

    Mangalore, Karnataka, India Iilika Groups Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Title: Data Engineer (Contract)About the RoleWe are seeking an experienced Data Engineer with expertise in Snowflake, AWS, Python, MySQL, DevOps, PySpark, Power BI, REST API, and Azure. In this role, you will be responsible for designing, building, and optimizing scalable data pipelines and infrastructure to support analytics, reporting, and business...

  • Lead Data Engineer

    4 weeks ago

    Mangalore, India Whatjobs IN C2 Full time

    Our Team: Enterprise Business Solutions Vista’s Enterprise Business Solutions (EBS) domain is working to make our company one of the most data-driven organizations to support Finance, Supply Chain, and HR functions. The cross-functional team includes product owners, analysts, technologists, data engineers and more – all focused on providing Vista with...

  • Data Engineering Specialist

    21 hours ago

    mangalore, India beBeeDataEngineering Full time

    Job Title: Data Engineering SpecialistJob Description:We are seeking a talented Data Engineering Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing and developing secure, high-quality production code and data pipelines.This role offers hands-on experience with real-world big data activities,...

  • Data engineer – cdp

    1 week ago

    Mangalore, India Integers.Ai Full time

    Job Description: Data Engineer – CDP Role: Data Engineer – CDP Job Location: Remote Experience: 4-8 years About the Role We are seeking an experienced Data Engineer with strong CDP expertise to join our team. The ideal candidate will have hands-on experience working with Customer Data Platforms—specifically Real-Time CDP and Salesforce CDP—along with...

  • Aws data engineer

    2 weeks ago

    Mangalore, India Tata Consultancy Services Full time

    Dear Candidates, Greetings from TCS!!! TCS is looking for AWS data engineer Experience: 8-10 years Location: Kolkata, Hyderabad, Bangalore, Chennai, Pune, Gurgaon Required technical skill set: AWS Data & AI Must have skill sets: Strong hands-on experience with AWS Data Services: Amazon S3, Glue, Redshift, Athena, Kinesis, EMR. Expertise in AWS AI/ML...