Sr. Data Engineer

2 weeks ago

Hyderabad, Telangana, India Minfy Full time
About the job
Company Profile

Minfy is an award-winning cloud native Systems Integrator with specialised capabilities in end-to-end digital transformation.
Minfy offers full bouquet of consulting and delivery services working backwards from business imperatives.

Minfy has exclusive digital maturity frameworks to translate business goals into Intelligent application/platform engineering, unlocking data value for organisation competitiveness and leveraging the power of cloud infrastructure.

Mission
Minfy's core mission is to augment human capacity in customer organizations.
It enables its customers to become future ready.
Minfy not only helps customers visualize but actualize their future.
It recognizes that each customer and their context is unique, and the journey must be tailormade.

Minfy highlights:
Minfy has won AWS India Partner of year awards three times.
Recognised as Fastest growing companies by the Financial times
Minfy has operations in the US, Australia, South-East Asia and India

Key practices include:
AI/ML, Data & Analytics, Intelligent Application Engineering, Cloud Migration and Modernisation and Site Reliability Engineering

Industry Focus:
Logistics, Manufacturing, HCLS, FSI, Aerospace & Satellite
Leadership team from Global Majors – AWS, Microsoft, Deloitte, Capgemini, Infosys, PWC

Summary:
We are seeking an experienced AWS Data Engineer to join our data engineering team.

The ideal candidate will have a strong background in designing and implementing data pipelines, data warehouses, and data lakes on the AWS cloud platform.

You will be responsible for building and maintaining robust, scalable, and efficient data solutions that support our data analytics and machine learning initiatives.


Responsibilities:

Data Architecture:
Design and implement data architecture solutions on AWS, including data lakes, data warehouses, and streaming data pipelines.

ETL Development:

Develop and maintain ETL (Extract, Transform, Load) processes to ingest, process, and transform data from various sources into a usable format for analytics and reporting.


Data Modeling:
Create and maintain data models that support analytical and reporting requirements.
Optimize data structures for performance and scalability.

AWS Services:

Leverage a wide range of AWS services such as S3, Redshift, Glue, EMR, Athena, Kinesis, Lambda, and more to build data solutions.


Data Quality:
Implement data quality checks and monitoring to ensure data accuracy, completeness, and reliability.

Performance Optimization:
Continuously optimize data pipelines and infrastructure for improved performance, cost efficiency, and scalability.

Security and Compliance:
Implement data security and compliance best practices, including data encryption, access controls, and auditing.

Documentation:
Maintain comprehensive documentation of data engineering processes, configurations, and workflows.

Collaboration:

Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and provide data engineering support.


Troubleshooting:
Diagnose and resolve data engineering-related issues in a timely manner.

Qualifications:
Bachelor's degree in computer science, Information Technology, or a related field.
Master's degree is a plus.
Proven experience as a Data Engineer with a strong focus on AWS cloud platform.
In-depth knowledge of AWS services and tools for data engineering and analytics.
Proficiency in programming languages such as Python, Java, or Scala.
Strong SQL skills and experience with relational databases and data warehousing concepts.
Experience with big data technologies such as Hadoop, Spark, and Kafka.
Understanding of data governance, data quality, and data privacy.
Excellent problem-solving and troubleshooting skills.
Strong communication and collaboration skills.
AWS certifications (e.g., AWS Certified Data Analytics, AWS Certified Data Warehousing) are a plus.
5+ years of experience in data engineering / Data integrations.

Formative years may be in development projects in data warehouses, datamarts, ETL, data modelling, data rich middleware's, and distributed computing solutions.

3+ years in Cloud services with at least 1 implementation/development project
Last 3 years need to be in big data engineering – Cloud Integrations, Serverless, S3/BLOB, Hadoop, HBase, Hive, Spark, Spark streaming, Kafka in-memory database systems, Databases (No SQL and SQL)
Should have programmed extensively in python, Pyspark, scala, java
Should have managed an industry standard program in cloud building data pipelines, data migrations or analytics pipelines.
Good to have exposure to Apache airflow.

Should have worked as software solution provider at the level of solution architect, technology evangelist in medium to large ISV.

Direct experience of at least 3 years in design and delivery of bigdata solutions in healthcare vertical.

Preferred Skills:
Experience with serverless computing using AWS Lambda.
Familiarity with containerization and orchestration using Docker and Kubernetes.
Knowledge of Dev Ops practices and CI/CD pipelines.
Experience with data orchestration tools like Apache Airflow.

  • Digital Engineering Sr. Engineer

    4 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).• Experience in...

  • Digital Engineering Sr. Engineer

    1 month ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).• Experience in...

  • Sr Engineer Data Engineering

    1 week ago

    Hyderabad, Telangana, India TransUnion LLC Full time

    What We Bring to the Table: Looking for a Data Engineer to merge big data, marketing analysis, and database tech for top-notch insights. Need someone hands-on with data, keen on database product development, and good at teamwork. If you're curious about various industries, passionate about data analytics, a SQL lover, and skilled in creating efficient...

  • Sr Engineer Data Engineering

    2 weeks ago

    Hyderabad, Telangana, India TransUnion LLC Full time

    What We'll Bring:We are looking for Data Engineer to bring big data, marketing analytics, and database technology together to deliver best-in-class insights. You must be a hands-on data guru who's passionate about data, database product development, and play well with others. If you have a curiosity for different industries and companies, a passion for data...

  • Sr Data Engineer, SMAI

    2 weeks ago

    Hyderabad, Telangana, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all.Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever.JR47215 Sr Data Engineer, SMAIAs a Sr. Big Data Engineer at...

  • Sr Data Engineer, SMAI

    2 weeks ago

    Hyderabad, Telangana, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47215 Sr Data Engineer, SMAI As a Sr. Big Data...

  • Sr Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Syniverse Full time

    Syniverse is the world's most connected company. Whether we're developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world's most recognized brands. Eight of the...

  • Sr Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Syniverse Full time

    Syniverse is the world's most connected company. Whether we're developing the technology that enables intelligent cars to safely react to traffic changes or freeing travelers to explore by keeping their devices online wherever they go, we believe in leading the world forward.Which is why we work with some of the world's most recognized brands. Eight of the...

  • Sr QA Engineer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr QA Engineer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Why the Role Is Important: Our QA Test...

  • sr. data engineer,smai

    2 weeks ago

    Hyderabad, Telangana, India Micron Full time

    Our vision is to transform how the world uses information to enrich life for all. Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. JR47097 SR. DATA ENGINEER,SMAI 6+ years of proven...

  • Big Data Engineer, Data Modeling

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Modeling

    2 weeks ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friendswhen they ask you what you do?We're looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...

  • Big Data Engineer, Data Analysis

    1 week ago

    Hyderabad, Telangana, India data Full time

    What can you tell your friends when they ask you what you do? "As a Data Analyst at , I help analyze, monitor, and deliver comprehensive and high-quality app market data to app professionals. I am empowered to work independently with the support of team members spread across APAC, AMER, and EMEA. I am the key contributor to the new and existing product...

  • Sr Data/ML Engineer

    2 weeks ago

    Hyderabad, Telangana, India SS&C Technologies Holdings Full time

    Job DescriptionTitle:Sr Data/ML Engineer, IDSLocation: HyderabadIntralinks is a leading financial technology provider for the global banking, deal making and capital markets communities. We've earned the trust and business of more than 99 percent of the Fortune 1000 and have executed over $34.7 trillion worth of financial transactions on our...

  • Sr. Staff Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India 451 Discovery Comm. India Full time

    Who We Are...When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the bringing our characters to life, the bringing them to your living rooms and the creating what's next...From...

  • Sr Data/ML Engineer

    2 weeks ago

    Hyderabad, Telangana, India SS&C Technologies Holdings Full time

    Job Description Title: Sr Data/ML Engineer, IDS Location: Hyderabad Intralinks is a leading financial technology provider for the global banking, deal making and capital markets communities. We've earned the trust and business of more than 99 percent of the Fortune 1000 and have executed over $34.7 trillion worth of financial transactions on our...

  • Sr BODS Developer

    2 weeks ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job DescriptionReq ID:284992NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr BODS Developer to join our team in Hyderabad, Telangana (IN-TG), India (IN).Sr SAP BODS...

  • Sr. Staff Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India WARNERMEDIA Full time

    Welcome to Warner Bros. Discovery... the stuff dreams are made of.Who We Are... When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...

  • Sr. Staff Data Engineer

    1 month ago

    Hyderabad, Telangana, India WARNERMEDIA Full time

    Welcome to Warner Bros. Discovery... the stuff dreams are made of.Who We Are... When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life,...

  • Sr. Staff Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India 451 Discovery Comm. India Full time

    Who We Are... When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the bringing our characters to life, the bringing them to your living rooms and the creating what's next... ...