Senior Data Engineer
1 month ago
JOB DESCRIPTION
The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.
The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering Centre of Excellence in Bangalore, India. This is a great opportunity to join a data-first media company and be part of our Enterprise Data Platform team that prides itself in making Clients a data-driven organization. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.
A SNAPSHOT OF YOUR RESPONSIBILITIES
- Collaborate with and across Agile teams to design and develop data engineering solutions by rapidly delivering value to our customers
- Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
- Design and develop highly optimized data engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
- Build highly performing real-time data ingestion solutions for streaming workloads
- Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
- Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
- Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
- Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
- Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
- Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.
- Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
- Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
- Communicate clearly and effectively to technical and non-technical leadership
WHAT YOU WILL NEED
- Education: Bachelor’s degree in Computer Science, Computer Engineering, or relevant field
Work Experience:
- Senior Data Engineer: 7+ years of experience in architecting, designing and building Data Engineering solutions and Data Platforms
- Experience in building Data Warehouses/Data Platforms on Redshift/Snowflake
- Experience working with data acquisition and transformation tools such as Fivetran and DBT
- Experience building highly optimized & efficient data engineering pipelines using Python, PySpark
- Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink
- Experience working with real-time data streams processing using Apache Kafka, Kinesis or Flink
- Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)
- Expertise in Advanced SQL programming and SQL Performance Tuning
- Experience with version control tools such as GitHub or Bitbucket.
- Expert level understanding of dimensional modeling techniques
- Excellent communication, adaptability, and collaboration skills
- Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
- Strong logical and problem-solving skills with critical thinking
NICE TO HAVE, BUT NOT A DEALBREAKER
- Experience in designing and building applications using Container and serverless technologies
- Experience working with fully automated workflow scheduling and orchestration services such as Apache Airflow
- Experience working with semi-structured, unstructured data, No SQL databases
- Experience with CI/CD using GitHub Actions or Jenkins
- Experience designing and building APIs
-
Senior Data Engineer
1 month ago
Bengaluru, India Giant Eagle GCC Full timeSr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...
-
Senior Data Engineer
2 weeks ago
Bengaluru, India Capleo Global Full timeSenior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:1. Spark2. Databricks3. PySpark or Scala4. SQL & Python5. Github6. DWH (Snowflake or Presto or Hive or Hadoop)7. Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are...
-
Senior Data Engineer
1 month ago
Bengaluru, India Giant Eagle GCC Full timeSr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest...
-
Senior Data Engineer
1 month ago
Bengaluru, India Giant Eagle GCC Full timeSr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest...
-
Senior Data Engineer
1 month ago
Bengaluru, India Giant Eagle GCC Full timeSr Data Engineer Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...
-
Senior Data Engineer
1 month ago
Bengaluru, India Mitchell Martin Inc. Full timeJOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...
-
Senior Data Engineer
1 month ago
Bengaluru, India Mitchell Martin Inc. Full timeJOB DESCRIPTION The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers. The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India Capleo Global Full timeSenior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India Capleo Global Full timeSenior Data EngineerExperience: 7-9 yearsLocation: BengaluruAvailability: Immediate to 30 daysMandatory Skills:SparkDatabricksPySpark or ScalaSQL & PythonGithubDWH (Snowflake or Presto or Hive or Hadoop)Data Pipeline & Data ModelWe are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about shaping the...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India Capleo Global Full timeSenior Data Engineer Experience: 7-9 years Location: Bengaluru Availability: Immediate to 30 days Mandatory Skills: Spark Databricks PySpark or Scala SQL & Python Github DWH (Snowflake or Presto or Hive or Hadoop) Data Pipeline & Data Model We are seeking an experienced Senior Data Engineer to join our dynamic team in Bengaluru. If you are passionate about...
-
Senior Data Engineer
2 days ago
Bengaluru, India Twenty20 Systems Full timeWe are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...
-
Senior Data Engineer
1 month ago
Bengaluru, India Mitchell Martin Inc. Full timeJOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...
-
Senior Data Engineer
3 weeks ago
Bengaluru, India ZoomInfo Full timeSenior Data EngineerPosition: Senior Data EngineerLocation: BangaloreExperience : 7-10 YearsAbout the Role:Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a developer and...
-
Senior Engineer, Data
1 month ago
Bengaluru, India News Corp Full timeJob Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement, measurement and...
-
Senior Data Engineer
3 weeks ago
Bengaluru, India JLL Full timeJob Description Senior Data Engineer About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build a...
-
Senior Data Engineer
4 weeks ago
Bengaluru, India News Corp Full timeJob Description: Senior Data EngineerAbout the RoleWe are looking for aSenior Data Engineerwith experience in excellent analytical abilities inGCP BigQuery, ETL/BI, Python,Composer/Airflow,DataFusion, SQL,GCP Services- with the ability to operate in an agile environment and keen to detail while understanding the larger data warehouse.Skills & CompetenciesA...
-
Senior Data Engineer
3 weeks ago
Bengaluru, India Squareroot Consulting Pvt Ltd Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...
-
Senior Data Engineer
7 days ago
Bengaluru, India Recro Full timePosition: Senior Data EngineerLocation: BangaloreType: Full-TimeExperience Level: 4.5+ yearsJob Description:We're building a high-performing data team and searching for a skilled and passionate Data Engineer to join us! You'll be responsible for designing, developing, and maintaining our data infrastructure, ensuring a steady flow of clean, high-quality data...
-
Senior Data Engineer
1 week ago
Bengaluru, India Valiance Solutions Full timeAbout Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...
-
Senior Data Engineer
6 days ago
Bengaluru, India Valiance Solutions Full timeAbout Valiance:Valiance is a niche AI consulting firm dedicated to transforming businesses by leveraging the power of data science, AI, and cloud technologies. With a team of over 120 professionals, we provide cutting-edge solutions to clients in the US and India.Job Overview:We are seeking a highly skilled and experienced Senior Databricks Engineer to join...
