
Senior Data Pipeline Developer
2 days ago
Data Engineer Opportunity
We are seeking an experienced data engineer to join our team in a role that will involve designing, developing, testing, and supporting data pipelines and applications using Python, PySpark, and SQL on AWS.
- Key Responsibilities:
- Designing and developing scalable and efficient data pipelines using Python, PySpark, and SQL on AWS
- Maintaining and optimizing existing data pipelines and applications to ensure high performance and data quality
- Collaborating with cross-functional teams to understand business requirements and translate them into technical solutions using AWS cloud services and Python/PySpark
- Developing and maintaining applications using Python and PySpark for data manipulation, transformation, and analysis
- Leveraging experience with ETL tools, GitHub, and DevOps to streamline data integration processes
- Providing expert-level guidance and support to junior team members and stakeholders on data engineering best practices
- Staying up-to-date with emerging technologies and trends in data engineering and applying this knowledge to drive innovation and improvement within the team
- Requirements:
- 5+ years of experience in data integration and pipeline development
- Strong background in AWS services, including Glue, PySpark, SQL, Databricks, and Python
- Experience with ETL tools, GitHub, and DevOps
- Proficiency in PL/SQL, T-SQL for data querying, manipulation, and database interactions
- Excellent written and verbal communication skills to collaborate with team members and stakeholders
- Leadership and mentoring experience in a technical environment
- Familiarity with Snowflake and Palantir Foundry is a plus
-
Advanced Data Pipeline Developer
2 days ago
Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,00,000Senior Data Engineer Job OpportunityWe are looking for a highly skilled Senior Data Engineer to lead our team in developing efficient data pipelines, following best practices and standards.Key Responsibilities:Develop scalable ETL pipelines that meet business requirements and adhere to company standards.Perform thorough integration testing of created...
-
Senior Data Pipeline Specialist
1 week ago
Chennai, Tamil Nadu, India beBeeDataPipeline Full time ₹ 18,00,000 - ₹ 24,00,000Job Title:Senior Test Engineer - Data Pipeline Specialist About the Job We are seeking an experienced Senior Test Engineer to drive testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. Key Responsibilities Develop and...
-
Lead Data Pipeline Developer
1 week ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 27,00,000Senior Data EngineerYou will play a key role in driving the development and implementation of our data pipeline, working closely with DW/BI leads to understand new ETL pipeline requirements.With 5+ years of experience, you will collaborate with stakeholders to identify gaps in existing pipelines and develop data models for reporting needs.As a seasoned data...
-
Senior Data Pipeline Developer
3 days ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000\As a key member of our Data Engineering team, you will play a critical role in designing and developing scalable data infrastructure that supports business intelligence.\The ideal candidate has strong SQL skills, hands-on experience with cloud ETL tools, and a passion for building robust data pipelines.\Required Skills and Qualifications:\\5–8 years of...
-
Senior Data Pipeline Developer
2 weeks ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000As a Data Engineer, you will play a crucial role in designing, developing and implementing scalable and high-performance data pipelines. Key Responsibilities:Data IngestionTranslate business requirements into technical specifications and solutions.Create and maintain documentation for data processes and flows.Perform data validation, profiling, cleansing and...
-
Senior Data Pipeline Developer
18 hours ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000Job DescriptionOur team is seeking a skilled professional to work on the development of data pipelines, transformations of data, and participation in proof-of-concept projects for new data patterns. The successful candidate will be responsible for optimizing existing data feeds and enhancing them to meet business requirements.
-
Data Pipeline Developer
7 days ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job SummarySnowflake DBT Developer: Design and Develop Data PipelinesKey Responsibilities:Develop robust data pipelines using DBT, integrating Talend data, and ensuring high-quality data in big data environments.Write complex SQL queries against Snowflake and create scripts in Unix, Python, etc. to perform Extract, Load, and Transform operations.Maintain and...
-
Senior Data Engineer
1 week ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Key Responsibilities:We are seeking a seasoned data engineering professional to lead the design and development of robust data pipelines using Azure Data Factory.Collaborate with cross-functional teams to identify complex data requirements and deliver tailored solutions that meet business objectives.Stay updated on the latest Azure Data Factory features and...
-
Pipeline Developer
4 days ago
Chennai, Tamil Nadu, India beBeeSourcing Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Senior Sourcing ManagerWe are seeking an experienced Senior Sourcing Manager to join our team. In this role, you will play a key part in strengthening our presence in the real estate market by developing strong relationships with channel partners and developers.Key Responsibilities:Establish and maintain strong relationships with channel partners,...
-
Expert Data Pipelines Developer
12 hours ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking a skilled and experienced Azure Databricks Engineer to build scalable data pipelines and streaming architectures using Azure-native technologies.Key Responsibilities:Design, develop, and optimize data pipelines using Databricks (PySpark) for batch and real-time data processing.Implement CDC (Change Data Capture) and Delta Live...