Data Platform Engineer

1 month ago

India ApTask Full time

Primary responsibilities: Lead the design and engineering of a scalable, secure, and cost-optimized Streaming Data Platform Lead role in evolving from (current) on-prem to hybrid cloud infrastructure with Kafka as the core technology Lead platform upgrades and installs. Perform the procedures in Development. Collaborate with Operations team in production. Develop automation of platform components (infrastructure as code) Integrate platform metrics into the Syniverse monitoring stack Execute DB performance analysis. Collaborate with Development teams to provide results and recommendations. This includes queries, DB schema design, and aggregation layers. Perform Capacity analysis to be applied directly in planning infrastructure design/purchases Communicate results/recommendations to leadership team Qualifications : Bachelor’s Degree in Computer Science or equivalent 10+ years relevant experience managing Database, Analytics, and Streaming Platforms. 7+ years of programming with Java, python, or Go 5+ years of Linux experience in both scripting and administrative role 4+ years Kafka with a preference for Confluent platform: Deploying and managing Brokers, Zookeeper, Schema Registry, ksqlDB, and Connectors Setup mirroring of Kafka topics data across clusters, DCs, and Cloud Cloud skills: Production experience with Public Cloud. AWS strongly preferred. Production experience deploying Kafka in cloud and on-prem Production experience deploying cloud native DB services in the cloud Experience performing assessment of Cloud and on-prem data system DBA experience with preference for PostgreSQL or similar relational database Production experience tuning queries and optimizing performance on large scale Analytic DBs Experience developing automation scripts for infrastructure and platform with Ansible strongly preferred Demonstrates understanding of Data Model design and tradeoffs Demonstrates ability to work across teams including Operations, Development, DBA, and Infrastructure admins Demonstrates clear communication to peers and leadership

  • Senior Data Integration Engineer | Senior Data Integration Engineer | india

    1 hour ago

    india Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Platform Engineer

    5 days ago

    India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia) Department: Data and AI Employment Type: Full-time About GeoTech GeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI,...

  • Data Platform Engineer

    2 weeks ago

    India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia) Department: Data and AI Employment Type: Full-time About GeoTech GeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer...

  • Data Platform Engineer

    2 weeks ago

    India GeoTech Full time

    Location: [Remote, with occasional travel to Riyadh, Saudi Arabia]Department: Data and AIEmployment Type: Full-timeAbout GeoTechGeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI, computer vision, and...

  • Data Platform Engineer

    2 weeks ago

    India GeoTech Full time

    Location: (Remote, with occasional travel to Riyadh, Saudi Arabia) Department: Data and AI Employment Type: Full-time About GeoTech GeoTech is at the forefront of data-driven innovation, combining cutting-edge technology with advanced geospatial analytics. Our solutions empower businesses with actionable insights, leveraging the power of AI,...

  • Data Platform Engineer

    4 weeks ago

    India Luxoft Full time

    Job Overview:As a Data Platform Engineer at Luxoft, you will be responsible for designing and implementing a scalable data collection, storage, and distribution platform to house data from various sources. This platform will provide data to systematic and fundamental PMs, as well as enterprise functions, including Ops, Risk, Trading, and Compliance. You will...

  • Data Engineer

    3 days ago

    India Atlas - the Recruitment Platform Full time

    Before you start reading, please read this carefully! I've spent a good amount of time thinking about what to write :D Who we are Atlas Technologies is an anti-CRM built solely for recruitment professionals. A customer relationship management tool is a required software to run any business. The problem is that data entry is extremely...

  • Lead data engineer

    5 days ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Data Engineer

    3 days ago

    India Atlas - the Recruitment Platform Full time

    Before you start reading, please read this carefully! I've spent a good amount of time thinking about what to write :DWho we areAtlas Technologies is an anti-CRM built solely for recruitment professionals.A customer relationship management tool is a required software to run any business. The problem is that data entry is extremely onerous and these systems...

  • Data Engineer

    3 days ago

    India Atlas - the Recruitment Platform Full time

    Before you start reading, please read this carefully! I've spent a good amount of time thinking about what to write :D Who we are Atlas Technologies is an anti-CRM built solely for recruitment professionals. A customer relationship management tool is a required software to run any business. The problem is that data entry is extremely onerous and these...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    2 weeks ago

    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • Aws data engineer

    2 days ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Lead Data Engineer: Strategic Data Architect

    2 weeks ago

    India Wavicle Data Solutions Full time

    Wavicle Data Solutions is seeking an experienced Lead Data Engineer to play a pivotal role in architecting and implementing data solutions.About the RoleThis position offers a competitive salary of $180,000 - $220,000 per annum, commensurate with experience. Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using Python and...

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 weeks ago

    india ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    2 weeks ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    3 months ago

    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Wavicle Data Solutions | Lead Data Engineer | india

    2 weeks ago

    india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...