Senior Data Engineer

4 weeks ago

Agra, India Cloudwick Full time

About the roleWe are seeking Senior Data Engineers to join our data engineering team, who are passionate about data & analytics. The ideal fit for the role will have a strong background in handling large volumes of data with Apache Spark to build , enhance bespoke systems to harness data .The key focus of the position is to build or maintain systems to capture and store data on behalf of the business. Key ResponsibilitiesDesign, develop, and maintain ETL processes and data pipelines using AWS Glue with Pyspark. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and tune data pipelines for performance and scalability. Ensure data quality and integrity through robust testing and validation processes. Implement data governance and security best practices. Monitor and troubleshoot data pipelines to ensure continuous data flow and address any issues promptly.Stay up-to-date with the latest trends and technologies in data engineering. Required QualificationB.E/B.Tech, preferably in Computer Science Engineering with relevant work experience.7+ years of experience in handling data and designing ETL pipelines with mandatory 4+ years experience in writing Spark. Experience with AWS services such as Glue, Athena, S3, and Redshift is a plus.Good to have exposure to data modeling, data analytics, and design in both batch processing and real-time streaming. Solid understanding of data mapping, data processing patterns, distributed computing, and building applications for real-time and batch analytics Strong programming skills in design and implementation using Python, PySpark, SQL Good exposure in database architecture with SQL. Experience with multiple file formats like Avro, Parquet, ORC, and JSON. Developing, constructing, testing, and maintaining architectures for data lakes, data pipelines, data warehouses, and large-scale data processing systems on Databricks.

  • Senior Data Engineering Professional

    1 week ago

    agra, India beBeeDataEngineering Full time

    About the JobWe are seeking a highly skilled Senior Data Engineer to join our data engineering team. The ideal candidate will have extensive hands-on experience in building and optimizing data ingestion and transformation pipelines using Azure Data Platform, Databricks, Snowflake, and Kafka.You will be responsible for designing, developing, and maintaining...

  • Data Engineering Leader

    1 week ago

    agra, India beBeeDataEngineer Full time

    Job Title: Senior Data EngineerThe position of Senior Data Engineer involves designing, architecting, administering, and managing large database systems, particularly on Microsoft platforms.Develop complex SQL queries for data extraction, transformation, and analysis. Implement new databases, data warehouses, data pipelines, and ETL processes using Azure...

  • Senior Data Architect

    6 days ago

    agra, India beBeeData Full time

    We are seeking a Senior Data Architect to lead the design and delivery of enterprise data analytics solutions. The ideal candidate will own the architecture for ETL/ELT, data warehousing, analytics pipelines, data governance, and integrations with LMS/EdTech systems.The successful candidate will define end-to-end data architectures and roadmaps for...

  • Senior Data Platform Architect

    1 week ago

    agra, India beBeeDataEngineer Full time

    Data Engineering RoleWe're seeking a seasoned data engineer to join our team. As a key member, you'll be responsible for designing and implementing scalable data infrastructure, building ETL/ELT pipelines, and collaborating with senior-level engineers to ensure high-quality data platforms.Requirements:

  • Senior Data Engineer

    1 week ago

    agra, India beBeeDataEngineer Full time

    Unlock the Power of Data EngineeringThis role offers an exciting opportunity to work with cutting-edge technologies, focusing on data engineering and Unity Catalog. As a data engineer, you will be responsible for creating and managing catalogs, schemas, and tables using deep hands-on experience with Unity Catalog.Key Responsibilities:Create and manage data...

  • Senior Data Engineer

    5 days ago

    agra, India beBeeData Full time

    Protect Businesses from Cyber Threats ThreatXIntel is a startup dedicated to safeguarding businesses and organizations of all sizes from evolving cyber threats. Through continuous monitoring and vulnerability assessments, we ensure that digital environments remain secure. Key Responsibilities:Collaborate with cross-functional teams to handle stored...

  • Senior Cloud Data Engineer

    1 week ago

    agra, India beBeeDataEngineer Full time

    About the RoleThe role entails a comprehensive understanding of data engineering principles and Google Cloud Platform (GCP) services.Expertise in GCP services like Dataflow, BigQuery, Storage Classes, and Pyspark/Python is essential.Airflow knowledge is also necessary.The ideal candidate will possess 5+ years of experience and exceptional problem-solving...

  • Senior Reservoir Engineering Specialist

    6 days ago

    agra, India beBeeReservoir Full time

    Job Title: Senior Reservoir Engineering SpecialistDeliver exceptional results as a senior reservoir engineer, driving exploration support through strategic planning and guidance.Must hold a bachelor's degree or higher in petroleum engineering from a recognized institution.Develop and implement reservoir engineering activities to optimize exploration...

  • Senior Data Scientist and AI Strategist

    4 days ago

    agra, India beBee**DataScience** Full time

    Artificial Intelligence Engineer Job OverviewThe Data Science and Artificial Intelligence Competency Center focuses on leveraging data, analytics, and AI technologies to extract insights, build predictive models, and develop AI-powered solutions.This senior-level position will guide delivery and coordinate workstreams within the AI Engineering team. Key...

  • Data Engineer

    1 day ago

    agra, India BayOne Solutions Full time

    The Opportunity:We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end...