Senior data engineer python
Full TimeBookmark Details
Job Description
External Description:
Responsibilities:
– Design and build scalable solutions for acquiring and integrating data to meet the functional and non-functional requirements of the business.
– Develop and maintain processes for extracting, transforming, and loading (ETL) data from various sources.
– Optimize data integration systems for performance as data volume grows.
– Collaborate with development teams to implement data strategies, data flows, and models.
– Establish and maintain data quality standards across systems.
– Analyze complex data to develop business intelligence solutions.
– Follow best practices and company guidelines for data integration and system development.
– Translate business needs into technical designs and implement them.
– Convert data models and design specs into functional code.
– Proficient in writing complex SQL queries and developing stored procedures using SQL, JavaScript and/or Python.
– Monitor and troubleshoot system performance, and integrate new features when needed.
– Provide support by addressing system issues promptly.
– Having strong Python skills to develop Streamlit applications, automate data workflows, and integrate APIs for efficient data processing is a plus.
– Apply prompt engineering techniques to improve NLP-driven tasks for better data querying and insights.
Minimum Qualifications:
– Bachelor’s or Master’s degree in IT, Computer Science, or equivalent experience.
– 7+ years of experience in data integration or similar roles.
– 5+ years of hands-on experience with ETL and data integration processes.
– 2+ years of experience in data modeling, both physical and relational.
– Advanced proficiency in Snowflake, including its advanced features and utilities.
– In-depth understanding of data structures, database systems, and data mining techniques.
– Proficiency in Python, with a focus on building Streamlit applications and automating data tasks and processes, is highly desirable.
– Experience with prompt engineering for natural language processing (NLP) applications is a plus.
Share
Facebook
X
LinkedIn
Telegram
Tumblr
Whatsapp
VK
Mail