Sr. Data Engineer

7 days ago

Hyderabad, Telangana, India VidPro Consultancy Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

Experience: 5-8 Years
Work Mode: Pune & Hyderabad
Job Type: Fulltime
Mandatory Skills: Python, Pyspark, SQL, Snowflake, Airflow, ETL, Data Pipelines, Elastic Search, or AWS.
Role Overview
We are looking for a talented and passionate Senior Data Engineer to join our growing data team. In this role, you will play a key part in building and scaling our data infrastructure, enabling data-driven decision-making across the organization. You will be responsible for designing, developing, and maintaining efficient and reliable data pipelines for both ELT (Extract, Load, Transform) and ETL (Extract, Transform, Load) processes.

Responsibilities

  • Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
  • Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
  • Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
  • Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
  • Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
  • Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
  • Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
  • Contribute to the development and enhancement of our data warehouse architecture

Required Skills

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
  • At least 3+ years of exp in Snowflake data warehousing technologies.
  • At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
  • Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
  • Working experience with Elastic Search and its application in data pipelines.
  • Proficiency in SQL and experience with data modelling techniques.
  • Strong understanding of cloud-based data storage solutions such as AWS S3.
  • Experience working with NFS and other file storage systems.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.

Skills: data,pipelines,etl,skills,snowflake,aws,search,etl,airflow,data warehouse,data engineering,python,pyspark,sql,elasticsearch

  • Sr GCP Data Engineering

    1 week ago

    Hyderabad, Telangana, India Tech Stalwart Solution Full time

    Job DescriptionTech Stalwart Solution Private Limited is looking for Sr GCP Data Engineering to join our dynamic team and embark on a rewarding career journey- Build, manage, and optimize data pipelines on Google Cloud Platform- Develop ETL workflows, integrate cloud-based tools, and ensure data quality and scalability- Collaborate with analytics and...

  • Sr. Data Engineer

    1 week ago

    Hyderabad, Telangana, India Tech Stalwart Solution Full time

    Job DescriptionTech Stalwart Solution Private Limited is looking for Sr. Data Engineer to join our dynamic team and embark on a rewarding career journey.Responsibilities:- Liaising with coworkers and clients to elucidate the requirements for each task.- Conceptualizing and generating infrastructure that allows big data to be accessed and analyzed.-...

  • Sr Data Engineer

    7 days ago

    Hyderabad, Telangana, India Anblicks Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job descriptionPosition: Sr Data Engineer Location: Hyderabad or AhmedabadExperience: 5 yearsMode of work: HybridSkill: Python, PySpark, SQL & SnowflakePreferred Immediate to 30 days joiners. Key Responsibilities:Design, develop, and manage robust data pipelines using Snowflake, Python, and PySpark. Implement and optimise Snowflake features, including...

  • 15h Left: Digital Engineering Sr. Engineer

    1 week ago

    Hyderabad, Telangana, India NTT DATA Full time

    Req ID 320609NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Engineer to join our team in Hyderabad Telangana IN-TG India IN Job Requirements 4-6 Yrs ...

  • Lead/Sr. ETL Data Engineer

    7 days ago

    Hyderabad, Telangana, India Data Economy Full time US$ 90,000 - US$ 1,20,000 per year

    We are seeking a skilled ETL Data Engineer to design, build, and maintain efficient and reliable ETL pipelines, ensuring seamless data integration, transformation, and delivery to support business intelligence and analytics. The ideal candidate should have hands-on experience with ETL tools like Talend, strong database knowledge, and familiarity with AWS...

  • Sr Azure Data engineer with Informatica

    6 days ago

    Hyderabad, Telangana, India Cliff IT Solutions Inc. Full time

    Company DescriptionCliff IT Solutions is a leading provider of Identity Management and Security governance solutions for onsite and cloud applications. Our services help organizations reduce risk and maximize profitability through end-to-end integration of enterprise Identity access management products and cloud-based applications. We focus on delivering...

  • Sr Azure Data engineer with Informatica

    5 days ago

    Hyderabad, Telangana, India Cliff IT Solutions Inc. Full time

    Company Description Cliff IT Solutions is a leading provider of Identity Management and Security governance solutions for onsite and cloud applications. Our services help organizations reduce risk and maximize profitability through end-to-end integration of enterprise Identity access management products and cloud-based applications. We focus on delivering...

  • Sr Azure Data engineer with Informatica

    14 hours ago

    Hyderabad, Telangana, India Cliff IT Solutions Inc. Full time

    Company DescriptionCliff IT Solutions is a leading provider of Identity Management and Security governance solutions for onsite and cloud applications. Our services help organizations reduce risk and maximize profitability through end-to-end integration of enterprise Identity access management products and cloud-based applications. We focus on delivering...

  • Sr Manager Data Engineering

    7 days ago

    Hyderabad, Telangana, India Amgen Full time US$ 1,25,000 - US$ 1,75,000 per year

    Join Amgen's Mission of Serving PatientsAt Amgen, if you feel like you're part of something bigger, it's because you are. Our shared mission—to serve patients living with serious illnesses—drives all that we do.Since 1980, we've helped pioneer the world of biotech in our fight against the world's toughest diseases. With our focus on four therapeutic...

  • Sr BODS Developer

    4 weeks ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:333652NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr BODS Developer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Sr SAP BODS Developer -...