Data Engineer

1 day ago

Kottayam, Kerala, India ValueLabs Full time

Job Title: Data Engineer

Experience: 6+ yrs

Location: Hyderabad

Primary skill-

Data Engineer, AWS Glue, Lambda, ETL, Python, Airflow ,Snowflake

Job Description:

We are seeking a Data Engineer responsible for building, maintaining, and optimizing the infrastructure that enables data collection, storage, processing, and analysis.

Responsibilities-

* Design, develop, and maintain **ETL/ELT data pipelines** to ingest data from various sources, including databases and flat files, into our data warehouse.

* Hands-on experience with **AWS Cloud services**, including Lambda, DMS, and Glue. * Solid understanding of data warehousing concepts, with practical experience using **Snowflake**.

* Develop and optimize **Snowflake stored procedures** to implement complex business logic and data transformations.

* Manage and monitor scheduled data workflows using **Apache Airflow**.

* Work closely with stakeholders to understand project requirements and translate them into technical solutions, ensuring seamless integration with existing data pipelines.

* Implement and maintain robust **data quality checks** to ensure accuracy and reliability of all delivered datasets and reports.

* Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals.

* Deliver data sets to other AWS accounts and support the creation of Power BI reports.

* Strong proficiency in **SQL** scripting.

* Proficiency in **Python** for data manipulation and automation.

* Excellent problem-solving skills and the ability to design and implement solutions based on business requirements.

* Experience with the full software development lifecycle (SDLC) and project documentation.

* Familiarity with data quality best practices.

* Strong communication and collaboration skills.

  • Data Engineer

    4 weeks ago

    Kottayam, Kerala, India VicTree Solutions Full time

    VicTree Solutions is hiring for a Data Engineer for a contract role.Job Title: Data EngineerLocation: RemoteExperience: 5-9 YearsEmployment Type: Contract (6 months renewable)Budget: 10-12 LPAShift – Australian shiftPositions - 2Requirements:Google Cloud Platform experienceAzure Databricks experienceExperience in DBTExperience with secure coding...

  • Data Engineer

    6 days ago

    Kottayam, Kerala, India SourceFuse Full time

    SourceFuse Technologies hiring for Data Engineer with 3+ years for experience Job Summary:As a Data Engineer, you'll manage the invisible backbone of our analytics, building scalable data pipelines that fuel real-time insights for 630+ ships worldwide. Your work will turn raw data points into actionable intelligence, propelling machine learning models and...

  • Data Engineering Lead

    1 hour ago

    Kottayam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview We are seeking an experienced data engineer to design and implement scalable, high-performance data pipelines using AWS cloud services and Databricks. Design and develop data pipelines and workflows using AWS and Databricks.Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.Leverage Databricks for data...

  • Senior Data Scientist

    14 hours ago

    Kottayam, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data Engineer PositionWe are seeking a skilled Big Data Engineer to lead the design, development, and maintenance of scalable data pipelines and ETL processes.About the RoleThe ideal candidate will have a strong background in data engineering and experience working with big data ecosystems. They will collaborate with stakeholders to gather requirements...

  • Chief Data Engineer

    6 hours ago

    Kottayam, Kerala, India beBeeDeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Python DeveloperWe are seeking a skilled Python developer to join our team. As a key member of our engineering group, you will be responsible for designing, developing, and automating scalable ETL workflows using Python and Pandas.Key responsibilities include:Designing, developing, and automating scalable ETL workflows using Python and PandasImplementing and...

  • Master Data Engineering Specialist

    6 days ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a seasoned data professional to lead our Global Intelligence Practice.The ideal candidate will have strong foundational skills in data warehousing and engineering, with exposure to various data architecture types.The successful candidate will work closely with client stakeholders to capture requirements,...

  • Senior Data Engineer

    2 days ago

    Kottayam, Kerala, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...

  • Software Data Engineer

    17 hours ago

    Kottayam, Kerala, India beBeeDataReconciliation Full time ₹ 18,73,000 - ₹ 23,45,000

    **Job Overview**We're seeking an experienced software engineer to spearhead data reconciliation between SQL and Snowflake platforms.**Key Responsibilities**Design, develop, and execute automated tests for data reconciliation between SQL and Snowflake Administer Streamlit data tools for comprehensive testing**Requirements**4-10 years of experience in software...

  • Senior Data Engineer

    3 days ago

    Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    The Role:We are seeking an experienced Data Engineer to join our team.

  • Cloud Data Engineering Specialist

    18 hours ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Description">As a highly skilled Data Engineer, you will play a pivotal role in our organization by leveraging your expertise in data engineering and cloud technologies to drive business growth and innovation.With a strong background in Apache Ray, you will design, develop, and implement scalable and efficient data processing systems that meet the...