Large Scale Data Systems Engineer
3 days ago
Senior Data Engineer
\Are you a seasoned data engineer with 6-8 years of experience? Do you have a passion for building and maintaining large-scale data systems on AWS?
\ Job Description:\ As a senior data engineer, you will play a key role in designing and implementing efficient data pipelines using Spark, PySpark, and Scala. You will work closely with our analytics team to understand their requirements and provide solutions that meet their needs.\ Key Responsibilities:\ - Design and build data pipelines using big data tools and cloud technology - Manage complex data processes with Airflow, creating and fixing any issues with the workflows (DAGs) - Clean, transform, and prepare data for analysis - Use Python for data tasks, automation, and building tools - Work with AWS services like S3, Redshift, EMR, Glue, and Athena to manage our data infrastructure - Collaborate closely with the Analytics team to understand what data they need and provide solutions - Help develop and maintain our Node.js backend, using Typescript, for data services - Use YAML to manage the settings for our data tools - Set up and manage automated deployment processes (CI/CD) using GitHub Actions - Monitor and fix problems in our data pipelines to keep them running smoothly - Implement checks to ensure our data is accurate and consistent - Help design and build data warehouses and data lakes - Use SQL extensively to query and work with data in different systems - Work with streaming data using technologies like Kafka for real-time data processing\ Required Skills and Qualifications:\ - Bachelor's or Master's degree in Computer Science, Engineering, or a related field - 6-8 years of experience as a Data Engineer - Strong skills in Spark and Scala for handling large amounts of data - Good experience with Airflow for managing data workflows and understanding DAGs - Solid understanding of how to transform and prepare data - Strong programming skills in Python for data tasks and automation - Proven experience working with AWS cloud services (S3, Redshift, EMR, Glue, IAM, EC2, and Athena) - Experience building data solutions for Analytics teams - Familiarity with Node.js for backend development - Experience with Typescript for backend development is a plus - Experience using YAML for configuration management - Hands-on experience with GitHub Actions for automated deployment (CI/CD) - Good understanding of data warehousing concepts - Strong database skills OLAP/OLTP - Excellent command of SQL for data querying and manipulation - Experience with stream processing using Kafka or similar technologies\ Benefits:\ We offer a competitive salary and benefits package, including health insurance, retirement savings plan, and paid time off.\ How to Apply:\ If you are a motivated and experienced data engineer looking for a new challenge, please submit your resume and cover letter for consideration.-
Top Data Engineer for Large-Scale Projects
7 days ago
Bengaluru, Karnataka, India beBeeSeniorDeveloper Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Are you a highly skilled data engineering professional looking for a new challenge?We are seeking an experienced Senior Developer to join our team and lead the development of large-scale data processing systems on Google Cloud Platform.Job Description:The ideal candidate will have a strong background in data engineering and be proficient in designing,...
-
Unlocking Large-Scale System Potential
1 week ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 18,00,000 - ₹ 27,00,000Senior Software Engineer RoleThis is a challenging position where you will be designing and implementing new features for large-scale systems. As a key member of the Data Platform team, you will play a critical role in enabling customers to share their datasets hosted in our platform with engines and applications outside of it.Key Responsibilities:Design and...
-
Large Scale Data Architect
1 week ago
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Opportunity\ \A Data Systems Designer is required to develop and maintain large-scale data systems. This includes designing scalable data architectures, developing systems on public cloud providers, and working with NoSQL databases and APIs.\
-
Data Architect for Large-Scale Data Systems
6 days ago
Bengaluru, Karnataka, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Senior Data ArchitectWe are seeking a seasoned data architect to drive the design and implementation of scalable data systems. The ideal candidate will possess expertise in designing, building, and deploying efficient data pipelines using distributed data processing frameworks such as Spark and Databricks.Key Responsibilities:Design and deploy large-scale...
-
Large-Scale System Architectural Specialist
4 days ago
Bengaluru, Karnataka, India beBeeInfrastructure Full time US$ 2,00,000 - US$ 2,40,000Platform EngineerWe're looking for a skilled Platform Engineer to help us build and maintain our Search & Recommendations (S&R) platform.The ideal candidate will have extensive experience designing, building, and operating large-scale distributed systems. They'll need strong proficiency in modern backend languages such as Java, Python, or Go, as well as deep...
-
Large Data Engineer
3 days ago
Bengaluru, Karnataka, India beBeeData Full time ₹ 60,00,000 - ₹ 1,50,00,000About this Role : We are seeking a seasoned data expert to design, develop, and optimize large-scale data processing systems. This individual will work with high-volume, high-velocity datasets ensuring the platforms scalability, performance, and reliability. This role requires expertise in big data frameworks, distributed systems, and data engineering best...
-
Bengaluru, Karnataka, India beBeeBackendDeveloper Full time US$ 2,00,000 - US$ 2,50,000Staff Software Engineer, BackendWe're looking for a seasoned software engineer to drive the development of large-scale systems that meet our users' needs.About Us:We're a leading digital currency platform, seeking an expert in software engineering to help build the future of financial services.Your Role:As a Staff Software Engineer, you will be responsible...
-
Large Scale Distributed Software Engineer
4 days ago
Bengaluru, Karnataka, India beBeeSoftware Full time ₹ 1,80,00,000 - ₹ 2,54,00,000About the OpportunityDevelopers with expertise in large scale streaming platforms are sought after by a prominent technology company. The Data Infrastructure team is home to a thriving Kafka ecosystem, responsible for providing a messaging service that ensures high availability, durability, and end-to-end latency guarantees.This role offers the chance to...
-
Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Freelance Data Engineer Opportunity">We are seeking an experienced Freelance Data Engineer with expertise in Python, SQL, Linux/Bash, PySpark, AWS, and Databricks to design, build, and optimize large-scale data pipelines. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.
-
AI Leader in Large-Scale System Design
2 days ago
Bengaluru, Karnataka, India beBeeArtificialIntelligence Full time ₹ 2,03,20,000 - ₹ 2,56,80,000Protecting the Digital Way of LifeWe are committed to safeguarding our customers and believe that every team member's unique ideas contribute to our collective success.Job OverviewAs a Senior Staff AI Engineer for Enterprise AI Solutions, you will be part of a team responsible for hands-on design, development, and implementation of AI-powered solutions that...
