Intelletec
Senior Python Engineer (Data Engineer)
Job Description
As a core contributor to the Data Engineering team, your primary goals will be building pipelines that gather data from disparate sources, cleaning the data, and loading the transformed data into structures that are tailored to each client’s challenges and analytic approaches. You should have a solid understanding of how to access and extract data through various means (web services, web crawlers, direct access to source database, etc). You will create and apply custom solutions for data wrangling and develop semi-automated and automated ETL and database solutions.
Responsibilities
- Contribute to the design and development of our Python data workflow management platform
- Design and develop tools to wrangle datasets of small and large volumes of data into cleaned, normalized, and enriched datasets
- Build and enhance the Data Engineering codebase for added efficiency and capacity
- Refine processes for normalization and performance-tuning analytics
Qualifications
About You
- You bring deep experience in the architecture and development of quality backend production systems, specifically in Python
- You are excited by the opportunity to solve challenging technical problems, and you find learning about data fascinating
- You understand Server, Network, and Hosting Environments, RESTful and other common APIs, common data distribution, and hosted storage solutions
Must Have
- 3+ years of full-time experience in a professional, production environment
- Expertise in Python
- Experience with ETL and/or other big data processes
- Proficiency in multiple programming languages
Even Better
- Data skills: RDBMS SQL and NOSQL, structured and unstructured data, BigQuery
- Proficiency in Jupyter, C24; familiarity with ETL, CDC, and workflow tools
- Big data and cloud processing experience, e.g. HDFS, Spark
- Experience working in a cloud-based environment, such as GCP or the AWS
For more information, please contact [email protected]
