Data Engineer for Scalable Data Infrastructure
2 weeks ago
Job Overview
We are seeking a highly skilled and experienced Cloud Data Engineer to join Aditya Consulting's dynamic team. The ideal candidate will have a strong background in data engineering with a focus on Google Cloud Platform (GCP) services.
About the Role
The successful candidate will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure on GCP, ensuring data is accessible, reliable, and available for business use.
Main Responsibilities
- Data Pipeline Development: Design, develop, and maintain data pipelines using GCP services such as Dataflow, Dataproc, BigQuery, and Cloud Storage.
- Data Integration: Work on integrating data from various sources (structured, semi-structured, and unstructured) into GCP environments.
- Data Modeling: Develop and maintain efficient data models in BigQuery to support analytics and reporting needs.
- Data Warehousing: Implement data warehousing solutions on GCP, optimizing performance and scalability.
- ETL/ELT Processes: Build and manage ETL/ELT processes using tools like Apache Airflow, Data Fusion, and Python.
- Data Quality & Governance: Implement data quality checks, data lineage, and data governance best practices to ensure high data integrity.
- Automation: Automate data pipelines and workflows to reduce manual effort and improve efficiency.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver data solutions that meet business needs.
- Optimization: Continuously monitor and optimize the performance of data pipelines and queries for cost and efficiency.
- Security: Ensure data security and compliance with industry standards and best practices.
Required Skills and Qualifications
- Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
- Experience: 5+ years of experience in data engineering, with at least 2 years working with GCP.
- Technical Skills:
- Proficiency in GCP services: BigQuery, Dataflow, Dataproc, Cloud Storage, Pub/Sub, and Cloud Functions.
- Strong programming skills in Python, SQL, Pyspark and familiarity with Java/Scala.
- Experience with orchestration tools like Apache Airflow.
- Knowledge of ETL/ELT processes and tools.
- Experience with data modeling and designing data warehouses in BigQuery.
- Familiarity with CI/CD pipelines and version control systems like Git.
- Understanding of data governance, security, and compliance.
- Soft Skills:
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Ability to work in a fast-paced environment and manage multiple priorities.
Salary Range
$150,000 - $200,000 per year.
-
Bengaluru, Karnataka, India TMRW House of Brands Full timeAbout TMRW House of BrandsWe're a dynamic company pushing the boundaries in the data engineering space. As a Data Engineer at TMRW House of Brands, you'll play a pivotal role in building and maintaining our robust data infrastructure.Salary RangeThe estimated salary for this position is between $120,000 to $180,000 per year, depending on your level of...
-
Cloud Data Engineer for Big Data Solutions
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the Role:As a Cloud Data Engineer, you will be responsible for designing and implementing large-scale data processing systems using GCP's BigQuery, Dataflow, and Dataproc technologies. Your expertise in ETL/ELT pipelines, data warehousing, and lakehouse solutions will enable us to efficiently process structured and unstructured data.Key...
-
Data Engineer Cloud Migration Specialist
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Data Engineer Cloud Migration Specialist to join our team in Bangalore, India.The successful candidate will be responsible for designing, building and maintaining scalable data pipelines using Databricks on AWS, as well as integrating data from multiple sources using AWS services such as S3, Lambda, Glue, and...
-
Data Engineer: Scalable Data Architecture
3 days ago
Bengaluru, Karnataka, India TMRW House of Brands Full timeJob Description:TMRW House of Brands is seeking a highly skilled Data Engineer-II to design, develop, and maintain robust data pipelines for business intelligence and machine learning.About the Role:The ideal candidate will have 3-5 years of experience in data engineering and infrastructure space on big data technologies such as Hive, Spark, Pyspark,...
-
Data Engineer
3 days ago
Bengaluru, Karnataka, India Gloify Full timeAbout GloifyGloify is a fast-growing technology company that empowers businesses to thrive in the digital age. We're looking for talented professionals like you to join our team and contribute to our mission.Job SummaryWe are seeking an experienced Data Engineer to design, build, and maintain scalable data infrastructure. The ideal candidate should have...
-
Cloud Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewNTT DATA, a global leader in business and technology services, is seeking a highly skilled Cloud Engineer - Data Specialist to join our team in Bangalore, India.About the RoleWe are looking for an experienced Cloud Engineer with expertise in designing, building, and maintaining scalable data pipelines using Databricks on AWS. The ideal candidate...
-
Senior Time Series Data Engineer
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...
-
Senior Data Engineering Specialist
1 month ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a skilled Senior Data Engineering Specialist to join our team in Bangalore, India. The successful candidate will have a strong background in ETL development and data engineering using Azure concepts and technologies.Key ResponsibilitiesDesign and implement high and low-level design documents for ETL processes.Develop ETL code in...
-
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team in Bangalore, India. This role involves designing, building, and maintaining scalable data pipelines using Databricks on AWS.The ideal candidate will have experience with Databricks, including Apache Spark development, and proficiency in Python or Scala for Spark job development....
-
Data Engineering Specialist
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title: Data Engineering Specialist - BangaloreAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team in Bangalore, India. As a key member of our engineering team, you will be responsible for designing and developing high-quality data pipelines using ETL code in Databricks.Key Responsibilities:Develop high-level design...
-
Snowflake Data Engineer and Architect
4 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeAbout the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...
-
Cloud Infrastructure Expert
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title:Cloud Infrastructure Expert - Azure NetworkingAbout the Role:NTT DATA is seeking a highly skilled Cloud Infrastructure Expert in Azure Networking to join our team. The ideal candidate will have expertise in designing, implementing, and managing secure, scalable, and reliable network solutions in Azure.Responsibilities:Design and implement network...
-
Data Engineer
4 weeks ago
Bengaluru, Karnataka, India IBCScorp Full timeJob Title: Data Engineer - Scalable Data SolutionsAbout the Role:We are seeking a skilled Data Engineer to join our team at IBCScorp in Bangalore. The successful candidate will have experience working with Big Data technologies, including Spark, Scala, and NoSQL databases.Responsibilities:Design, develop, and deploy scalable data solutions using Big Data...
-
AI Data Science and Engineering Leader
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Title: AI Data Science and Engineering LeaderAbout the Role:We are seeking a highly skilled Ai Data Science and Engineering Leader to join our team in Bangalore, India. This is an excellent opportunity for a talented individual to lead our data science and engineering efforts.Responsibilities:Develop and implement traditional machine learning algorithms...
-
Lead Data Engineer
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Full timeJob Description:We are seeking a skilled Lead Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will be responsible for designing and implementing high-level design documents, building ETL code in Databricks, and performing unit and system integration testing.Responsibilities:Design and implement high-level...
-
Data Engineer Leader for Scalable Data Solutions
2 weeks ago
Bengaluru, Karnataka, India ThoughtFocus Full timeJob DescriptionWe are seeking a highly skilled Data Engineer Leader to join our team at ThoughtFocus. The ideal candidate will have 8-10 years of experience in designing and optimizing data pipelines, developing data infrastructure, and driving data integration projects.Key Responsibilities:Design and build robust data pipelines using Azure Data Factory...
-
Data Center Operations Specialist
1 week ago
Bengaluru, Karnataka, India NTT DATA Full timeJob OverviewNTT DATA is a global leader in IT services, with a strong presence in the data center industry. We are seeking an experienced Data Center Operations Specialist to join our team.About the RoleThe successful candidate will be responsible for the design, installation, and maintenance of complex mechanical, electrical, and infrastructure systems in...
-
Cloud Infrastructure Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeWe are seeking a Cloud Infrastructure Engineer to join our team in Bangalore, India.About the JobThis role is an exciting opportunity for a highly skilled professional to work with us on designing and managing data storage solutions within BigQuery and integration with other GCP services.Key ResponsibilitiesDesigning and implementing robust data pipelines...
-
Cloud Data Engineer for Big Data Processing
3 weeks ago
Bengaluru, Karnataka, India NTT DATA Services Full timeAbout the RoleWe are seeking a highly skilled Cloud Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will design, build, and maintain scalable data pipelines using Databricks on AWS.Job Responsibilities:Design and develop efficient data pipelines using Apache Spark and Databricks.Ingest data from multiple...
-
Data Solutions Architect
1 week ago
Bengaluru, Karnataka, India NTT DATA Services Full timeWe are currently seeking a highly skilled Data Solutions Architect to join our team in Bangalore, India.About the Role:As a Data Solutions Architect, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Main...