![Quantumbricks](https://media.trabajo.org/img/noimg.jpg)
Senior Data Engineer
4 days ago
We are seeking a highly motivated and experienced Sr. Data Engineer to join our growing team and play a critical role in designing, building, and maintaining our data pipelines on Google Cloud Platform (GCP).
You will leverage your in-depth knowledge of GCP data services and strong data engineering principles to develop scalable, efficient, and secure solutions that transform raw data into actionable insights for our business.
Responsibilities :
- Design, develop, and implement data pipelines for ingesting, transforming, and loading data at scale using GCP services like Cloud Storage, Pub/Sub, Dataflow, and BigQuery.
- Optimize data pipelines for performance and cost-efficiency, leveraging techniques like data partitioning, clustering, and materialized views in BigQuery.
- Design and implement data models within BigQuery to ensure data consistency, accuracy, and efficient querying.
- Automate data processing workflows using tools like Cloud Scheduler and Airflow.
- Develop and maintain data quality checks and monitoring dashboards to ensure data integrity throughout the pipeline.
- Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and translate them into technical specifications.
- Implement best practices for data security and access control within GCP.
- Stay up-to-date with the latest advancements in GCP data services and data engineering trends.
- Participate in code reviews and knowledge sharing within the engineering team.
Qualifications :
- 10+ years of experience in data engineering or a related field.
- Proven experience with cloud platforms, specifically Google Cloud Platform (GCP).
- In-depth knowledge of GCP data services including BigQuery, Cloud Dataflow, Cloud Storage, Pub/Sub, and Cloud Scheduler.
- Strong proficiency in SQL for data querying and manipulation.
- Experience with data modeling techniques and best practices.
-Familiarity with scripting languages like Python for data manipulation and automation tasks (a plus).
- Experience with data pipeline orchestration tools like Airflow (a plus).
- Excellent understanding of data security principles and practices.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
- Ability to independently manage projects, meet deadlines, and prioritize tasks effectively.
- Problem-solving skills and a passion for building innovative data solutions
-
Operations Specialist
2 weeks ago
India Data Engineer Academy Full timeJob Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...
-
Senior Data Engineer
4 weeks ago
india RoundCircle Full timeRound Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...
-
Senior Machine Learning Engineer
2 weeks ago
India K2 Data & Analytics Full timeJob Title: Senior Machine Learning EngineerWe are currently seeking a highly motivated Senior Machine Learning Engineer with extensive experience exceeding five years to join our dynamic team dedicated to leading the way in innovative Video Ad Data solutions.The ideal candidate for this position should possess a strong knowledge of machine learning...
-
Senior Data Engineer
2 weeks ago
India Next-Link Full timeJob Description Senior Data Engineer - Brussels - 12 moisOne of our important clients is currently looking for a Senior Data Engineer for a 12-month contract in Brussels.We are looking for a Senior Data Engineer who has extensive experience in developing and deploying data pipelines, infrastructure, and models for our data science projects. You will work...
-
Senior Data Engineer
2 weeks ago
India Mopid Full timeSenior Data Engineer Position Experience Range: 4-8 years Job Timing: This position is full-time Job Type: The role requires working in-office from our Hyderabad location. If you are passionate about leveraging data to drive business success, have a keen eye for detail, and are looking for an opportunity to bring your expertise to a vibrant team, we would...
-
Senior Data Engineer
2 weeks ago
India hunterAI Full timeCompany Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...
-
Senior Data Engineer
2 weeks ago
India Rigel Networks Pvt. Ltd. Full timeRole Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...
-
Senior Data Engineer
1 month ago
india OTSI Full timeJob Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...
-
Senior Data Engineer
4 weeks ago
india OTSI Full timeJob Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...
-
Senior Data Engineer
2 weeks ago
India Accelerant Full timeJob Type: ContractLocation: IndiaExperience: 8+ yearsRequired Experience:Hands-on experience with Fivetran, AWS S3, DBT, Redshift, and TableauRole Description:We are looking for a Senior Data Engineer to join our team at Accelerant. As a Senior Data Engineer, you will play a crucial role in data modeling, ETL processes, data warehousing, and data analytics....
-
Senior Data Engineer
1 month ago
india PrimEra Medical Technologies Full timeJob Description: Senior Data Engineer About PrimEra: PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact. Position Overview: We are seeking a highly skilled...
-
Senior Data Engineer
2 weeks ago
India Accelerant Full timeJob Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...
-
Senior Engineer
4 days ago
india NTT DATA Full timeJob Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...
-
Senior Data Engineer
4 weeks ago
india Next-Link Full timeJob Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...
-
Senior Data Engineer
2 weeks ago
India Next-Link Full timeJob Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...
-
Senior Data Engineer
2 months ago
india Next-Link Full timeJob Description We are searching for a talented Senior Data Engineer to join our team and support our client, a leading pharmaceutical company committed to pioneering healthcare solutions for both humans and animals. In this exciting role, you'll play a pivotal role in scaling up and globally rolling out their Customer Data Platform (CDP), a critical...
-
Senior Data Engineer
2 weeks ago
India OTSI Full timeJob Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer.Senior Data Engineer (Irving, Tx)JOB DESCRIPTION:• Analyze and understand data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data• Design and...
-
Senior Data Engineer
2 weeks ago
india MindBrain Full timeCompany Description. MindBrain seamlessly integrates innovation, education, and strategic workforce solutions. As a dynamic software company, we shape the future of technology. With a focus on comprehensive IT and non-IT training, we nurture talent, empowering individuals to lead in a rapidly evolving landscape. Through strategic resource augmentation, we...
-
Senior Data Engineer
2 weeks ago
India SourceBae Full timeSenior Data Engineer Exp-6+Yrs Shift Time : 2 PM - 11 PM As a Senior Data Engineer , you will: Design, Architect, and Develop solutions leveraging cloud big data technology to ingest, process and analyze large, disparate data sets to exceed business requirements Develop systems that ingest, cleanse and normalize diverse datasets, develop data...
-
Senior Data Engineer
2 weeks ago
India Apptad Inc. Full timeRole - Senior Data EngineerExp - 7+ yrsLocation - Bangalore/Hyderabad* Proficient in Python to design, develop, and maintain scalable data pipelines and ETL processes. * Has knowledge in pulling data using R via API's.* Extensive experience in building and optimizing data architectures, as well as strong skills in data modeling and SQL. * Capable enough to...