sr. data engineer.

3 weeks ago

Hyderabad Secunderabad Telangana, India Randstad Full time

The Randstad Offshore team is seeking an experienced Data Engineer with a passion for developing and implementing data solutions in Google Cloud Platform. The ideal candidate will have hands-on experience working with tools such as Cloud Composer (Apache Airflow), Cloud Storage, BigQuery, Cloud Functions and have experience with deploying batch and streaming pipelines.

The candidate must be inquisitive, detail oriented, and highly motivated for delivering high quality solutions. They must possess excellent communications skills, strong work ethic, and the ability to thrive in a fast paced, changing, high pressure environment.

Responsibilities:

  • Design, develop, and maintain data pipelines, to move and transform data from various sources (REST APIs, Emails, Flat files etc) into a unified data platform on BigQuery.
  • Build and maintain scalable data architecture and infrastructure that can handle large volumes of data with high velocity.
  • Implement reusable components around Data Quality and Data Standardization using BigQuery
  • Adheres to and advocates for software & data engineering best practices (eg technical design and review, unit testing, monitoring, alerting, source control, code review & documentation)
  • Deploys secure and well-tested software that meets privacy and compliance requirements develops, maintains and improves CI/CD pipeline
  • Collaborate with business analysts, data scientists, data analysts, BI teams and business stakeholders to understand the data needs and provide solutions to enable them to access the data they require.
  • Monitor and troubleshoot data pipelines to ensure their reliability and performance.
  • Mentors and shares knowledge with the team to provide design reviews, discussions and prototypes
  • Work seamlessly in an agile development envir onment to prioritize tasks and deliver results.

Qualifications:

  • Bachelor's degree in Computer Science, Computer Engineering, or a related field (BE/BTech)
  • 7+ years of experience within the field of Data Engineering
  • Experience in leading a team of 4 to 5 members
  • At least 3 years of experience working with Google Cloud Platform, BigQuery, Cloud Storage and Cloud Functions
  • At least 2 years of experience working with Cloud Composer (Apache Airflow)
  • At least 3 years of experience in Python
  • Strong experience in SQL and writing complex queries
  • Experience with Infrastructure management tools (Terraform etc)
  • Experience working with tools like Github, Gitlab, JIRA, Confluence and related tools
  • Excellent problem-solving skills, attention to detail and the ability to troubleshoot complex technical issues

Tools: Google Cloud Platform, Cloud Composer (Apache Airflow), BigQuery, Python, SQL, Terraform, Cloud Storage

  • Sr Engineer Data Engineering

    2 weeks ago

    hyderabad, India TransUnion LLC Full time

    What We'll Bring: We are looking for Data Engineer to bring big data, marketing analytics, and database technology together to deliver best-in-class insights. You must be a hands-on data guru who’s passionate about data, database product development, and play well with others. If you have a curiosity for different industries and companies, a passion...

  • Sr Data Engineer, SMAI

    3 weeks ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR47215 Sr Data Engineer, SMAIAs a Sr. Big Data Engineer at...

  • Sr Data Engineer

    3 weeks ago

    Hyderabad, India Syniverse Full time

    Syniverse is the world’s most connected company. Whether we’re developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world’s most recognized brands. Eight of...

  • Sr Data Engineer, SMAI

    4 weeks ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47215 Sr Data Engineer, SMAI As a Sr. Big Data...

  • Sr Data Engineer, SMAI

    4 weeks ago

    hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47215 Sr Data Engineer, SMAI As a Sr. Big Data...

  • Sr Data Engineer

    4 weeks ago

    Hyderabad, India Syniverse Full time

    Syniverse is the world’s most connected company. Whether we’re developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world’s most recognized brands. Eight...

  • Sr Data Engineer

    4 weeks ago

    hyderabad, India Syniverse Full time

    Syniverse is the world’s most connected company. Whether we’re developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world’s most recognized brands. Eight...

  • Sr Data/ML Engineer

    2 weeks ago

    Hyderabad, India SS&C Technologies Holdings Full time

    Job DescriptionTitle:Sr Data/ML Engineer, IDSLocation: HyderabadIntralinks is a leading financial technology provider for the global banking, deal making and capital markets communities. We’ve earned the trust and business of more than 99 percent of the Fortune 1000 and have executed over $34.7 trillion worth of financial transactions on our...

  • Sr Data/ML Engineer

    2 weeks ago

    Hyderabad, India SS&C Technologies Holdings Full time

    Job Description Title:  Sr Data/ML Engineer, IDSLocation: HyderabadIntralinks is a leading financial technology provider for the global banking, deal making and capital markets communities. We’ve earned the trust and business of more than 99 percent of the Fortune 1000 and have executed over $34.7 trillion worth of financial transactions on our...

  • Sr Data/ML Engineer

    2 weeks ago

    hyderabad, India SS&C Technologies Holdings Full time

    Job Description Title:  Sr Data/ML Engineer, IDS Location: Hyderabad Intralinks is a leading financial technology provider for the global banking, deal making and capital markets communities. We’ve earned the trust and business of more than 99 percent of the Fortune 1000 and have executed over $34.7 trillion worth of financial transactions on our...

  • Sr GCP Data Engineer, SMAI

    2 hours ago

    hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47217 Sr GCP Data Engineer, SMAI As a Sr. Data...

  • Sr GCP Data Engineer, SMAI

    1 day ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47217 Sr GCP Data Engineer, SMAI As a Sr. Data...

  • Hiring For Sr Full Stack Engineer NET and DevOps

    2 weeks ago

    Hyderabad/ Secunderabad, India timesjobs Full time

    Position: Sr. Full Stack Engineer - .NET and DevOpsDesired Profile Skills:.Net Fullstack DevopsCI/CD Pipeline - Bitbucket, Bamboo, Octopus, Ansible, ArtifactoryKubernetesKafkaScripting via Bash, Python, GoSecondary Skills:Test AutomationC#dotnet coreangularjsNotice Period: 30-45 daysEducation: BE, ME, BTECH, MTECH, MCALocation: HyderabadEmail:...

  • Senior Azure Data Engineer

    3 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    4 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    4 weeks ago

    hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Sr. Safety Specialist

    4 weeks ago

    Hyderabad, India Statistics & Data Corporation (SDC) Full time

    Sr. Safety SpecialistSDC is a team of diversified professionals who deliver exceptional Biometric Services, Consulting, and Technology Solutions to pharmaceutical, biologic, and medical device/diagnostic companies. Since 2005 our purpose has been to partner with sponsors to provide high quality and experienced team members to develop great medicines that...

  • Sr. Safety Specialist

    1 week ago

    hyderabad, India Statistics & Data Corporation (SDC) Full time

    Sr. Safety Specialist SDC is a team of diversified professionals who deliver exceptional Biometric Services, Consulting, and Technology Solutions to pharmaceutical, biologic, and medical device/diagnostic companies. Since 2005 our purpose has been to partner with sponsors to provide high quality and experienced team members to develop great medicines that...

  • Sr. Big Data Platform Engineer, SMAI

    6 days ago

    Hyderabad, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR53957 Sr. Big Data Platform Engineer, SMAIDo you believe...

  • Sr Engineer Data Engineering

    2 weeks ago

    Hyderabad, India TransUnion LLC Full time

    What We'll Bring:We are looking for Data Engineer to bring big data, marketing analytics, and database technology together to deliver best-in-class insights. You must be a hands-on data guru who’s passionate about data, database product development, and play well with others. If you have a curiosity for different industries and companies, a passion for...