Middle Big Data Engineer
7 дней назад
N-iX is looking a proactive Middle Data Engineer to join our vibrant team.
As a Middle Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.
Key Responsibilities:
- Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
- Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
- Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
- Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency.
- Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
- Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.
Tools and skills you will use in this role:
- Palantir Foundry
- Python
- PySpark
- SQL
- TypeScript
Requirements:
- 3+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry;
- Strong proficiency in Python and PySpark;
- Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
- Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
- Expertise in data modeling, data warehousing, and ETL/ELT concepts;
- Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
- Proficiency in containerization technologies (e.g., Docker, Kubernetes);
- Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;
- Strong communication and teamwork abilities;
- Understanding of data security and privacy best practices;
- Strong mathematical, statistical, and algorithmic skills.
Nice to have:
- Certification in Cloud platforms, or related areas;
- Experience with search engine Apache Lucene, Webservice Rest API;
- Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry;
- Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous;
- Previous experience working with JavaScript and TypeScript.
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
-
Big Data Analyst
18 часов назад
Украина, Украина «Київстар» Полный рабочий деньWe are looking for talented Data Analyst with a passion for managing, analyzing and visualizing data to find actionable Insights and help improve outcomes for our business and internal customers.Responsibilities:Deep-dive analysis of subscriber-data from large databases;Writing and running SQL queries to retrieve data from databases;Monitoring and auditing...
-
Middle Python/Data Engineer
2 недель назад
Украина, Украина SOMBRA Полный рабочий день 40 000 ₴ - 80 000 ₴ в годMiddle Python/Data EngineerHybridUkraineThe project: Our client is a private investment company based in the United States, specializing in agriculture and food-related investments. The main idea behind the product that we are developing is to boost the agricultural industry by providing farming companies with a comprehensive Business Intelligence tool. This...
-
Middle/Senior Data Support Engineer
1 неделя назад
Украина, Украина N-iX Полный рабочий день 40 000 ₴ - 80 000 ₴ в годN-iX is looking for a passionate, skilled and motivated Middle/Senior Data Support Engineer to join the team.Our customer is the leading school transportation solutions provider in North America. Every day, the company complete 5 million student journeys, moving more passengers than all U.S. airlines combined and delivers reliable, quality services including...
-
Middle Machine Learning Engineer
5 дней назад
Украина, Украина Data Science UA Полный рабочий деньData Science UA is a service company with strong data science and AI expertise. Our journey began in 2016 with the uniting top AI talents and organizing the first Data Science tech conference in Kyiv. Over the past 9 years, we have diligently fostered one of the largest Data Science & AI communities in Europe.About the Role:We're looking for a mid-level AI...
-
Strong Middle AQA Engineer
1 неделя назад
Украина, Украина HYS Enterprise Полный рабочий день 40 000 ₴ - 80 000 ₴ в годStrong Middle AQA Engineer (TS/JS)Ukraine/Europe • 3-5 years of experience • Full-time, Remote work • English - Upper-Intermediate (B2) • Ukrainian - NativeDescriptionWe are looking for a passionate and skilled Strong Middle AQA Engineer to join our dynamic product development team. In this role, you will be responsible for maintaining high software...
-
Senior Data Engineer
7 дней назад
Украина, Украина Description Ciklum Полный рабочий день 50 000 $ - 150 000 $ в годDescriptionCiklum is looking for a Senior Data Engineer to join our team full-time in Ukraine.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we...
-
Data Analyst
18 часов назад
Украина, Украина «Київстар» Полный рабочий деньWe are seeking a highly motivated and detail-oriented Data Analyst to join our dynamic Big Data team to execute Data Quality program. If you have a passion for data, a strong analytical mindset, and a desire to contribute to our data governance efforts, we want to hear from you.As a Data Quality Analyst, you will play a critical role in implementing data...
-
Senior Data Engineer
1 неделя назад
Украина, Украина N-iX Полный рабочий день 800 000 ₴ - 1 200 000 ₴ в годWe are seeking a proactive Senior Data Engineer to join our vibrant team. As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data...
-
Expert Data Engineer
7 дней назад
Украина, Украина Description Ciklum Полный рабочий день 45 000 $ - 90 000 $ в годDescriptionCiklum is looking for an Expert Data Engineer to join our team full-time in Ukraine.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we...
-
Middle DevOps Engineer
7 дней назад
Украина, Украина Description Ciklum Полный рабочий день 45 000 $ - 90 000 $ в годDescriptionCiklum is looking for a Middle DevOps Engineer to join our team full-time in Ukraine.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners,...