
Highly Skilled Data Engineer Needed for Large-Scale Project
6 days ago
Job Opening:
We are seeking a seasoned data engineer to spearhead the design, development, and maintenance of large-scale data processing systems on Google Cloud Platform (GCP).
Key Responsibilities:
- ETL Process Development: Design and implement efficient ETL pipelines using Python or Java to extract data from various sources, transform it into a standardized format, and load it into BigQuery.
- Data Ingestion and Processing: Build batch and streaming data ingestion pipelines using GCS, PubSub, Dataflow, or DataProc, and apply data processing techniques to extract insights from the data.
- Data Warehousing: Develop a deep understanding of data warehouse concepts, including database design, data modeling, and data visualization.
- Database Knowledge: Have a strong grasp of both SQL and NoSQL databases, including their use cases, advantages, and challenges.
- Scripting and Automation: Utilize scripting languages like Python or Java to automate tasks, integrate systems, and develop custom solutions.
Requirements:
- 4+ years of experience in data engineering, with a focus on GCP.
- In-depth knowledge of GCP services, including GCS, PubSub, Dataflow, DataProc, and BigQuery.
- Experience with ETL tools, such as Airflow/Composer.
- Strong understanding of data warehousing concepts and database management systems.
- Ability to work effectively in a remote environment.
What We Offer:
- Competitive compensation.
- Opportunities for growth and professional development.
- Collaborative and dynamic work environment.
-
Expertise in Large-Scale Data Processing
1 week ago
Anand, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Senior Data Engineer Position OverviewThe role of Senior Data Engineer entails designing and implementing large-scale data processing systems.Lead the development of scalable data architectures and pipelines using AWS services such as EMR, Glue, Lambda, Step Functions, API Gateway, and Athena.Collaborate with cross-functional teams to deliver complex data...
-
Senior Data Engineer
4 days ago
Anand, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data ArchitectWe are seeking a talented and experienced Data Architect to join our team. As a key member of our organization, you will be responsible for designing, building, and maintaining large-scale data systems.Key Responsibilities:Design and implement scalable data architectures that meet the needs of our business.Collaborate with...
-
Large Scale Data Processing Specialist
6 days ago
Anand, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Job Title:A Data Engineering Specialist with Expertise in PySparkAbout the RoleWe are seeking an experienced Data Engineering Specialist to lead the design, development, and optimization of large-scale data processing solutions using PySpark.The ideal candidate will have hands-on expertise in PySpark, Python, SQL, and real-time data streaming, as well as...
-
Chief Architect for Large-Scale Data Systems
5 days ago
Anand, Gujarat, India beBeeData Full time US$ 1,50,000 - US$ 2,50,000Senior Data EngineerThis role plays a key part in designing and developing large-scale data systems. As a bridge between engineering teams and business partners, you will contribute to the design and development of data pipelines, APIs, and platform components.Key Responsibilities:Drive development efforts by contributing high-quality, scalable, and...
-
Senior Data Science Engineer
1 week ago
Anand, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Software Engineer At Incept Labs, we believe in harnessing the synergy between humans and AI to propel education and research forward. Our mission is to create a harmonious partnership where AI's processing capabilities are augmented by human imagination, values, and experience.Our team of scientists, engineers, and builders is dedicated to developing...
-
Anand, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Sr. Azure Data Engineer Job Overview">Job Description: We are seeking a highly skilled Azure Data Engineer to lead the migration of large-scale SQL workloads from on-premise environments to Azure. The ideal candidate will have hands-on experience in modern data engineering tools and platforms within the Azure ecosystem, including data integration,...
-
Anand, Gujarat, India beBeeConstruction Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Project Management Construction Real Estate ProjectThis role involves overseeing the planning, scheduling, coordination, procurement, contracts, architecture, design, and quality for residential, commercial, and infrastructure projects. The ideal candidate will have expertise in setting project baselines, schedules, and reporting mechanisms for large-scale...
-
Freelance Big Data Specialist
2 weeks ago
Anand, Gujarat, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000We are seeking a seasoned Freelance Data Engineer to design and develop large-scale data pipelines using Python, SQL, and AWS.Key Responsibilities:Design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks for robust and high-performance data solutions.Perform data profiling, validation, and transformation using Python and SQL.Optimize...
-
Large Scale Event Manager
2 weeks ago
Anand, Gujarat, India beBeeEventProducer Full time ₹ 15,00,000 - ₹ 23,00,000Event Producer Role OverviewThis position involves managing the planning and execution of large-scale events to meet executive requirements.Key responsibilities include overseeing event strategy, identifying service gaps, and collaborating with stakeholders to align event production with corporate communications.Requirements:Exceptional organizational skills...
-
Data Engineering Expert
2 weeks ago
Anand, Gujarat, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Opportunity: Data Engineering ExpertJob Summary:We are seeking a highly skilled and experienced Data Engineer to join our team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines using Python and AWS services.Key Responsibilities:Data Pipeline Development: Develop and maintain complex data...