Data Engineer / Python Developer
Technocruitx Universal Services Pvt. Ltd.
Date: 3 weeks ago
City: Surat, Gujarat
Salary:
₹500,000
-
₹700,000
per year
Contract type: Full time
Skills:
Responsibilities
As a focused Data Engineer / Python Developer, you will be responsible for extracting and ingesting data from websites using web crawling tools. In this role, you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports, and data management. We will rely on you to test the data and the scrape to ensure accuracy and quality. You will own the process to identify and rectify any issues with breaks and scale scrapes as needed.
Requirements
Responsibilities
As a focused Data Engineer / Python Developer, you will be responsible for extracting and ingesting data from websites using web crawling tools. In this role, you will own the creation process of these tools, services, and workflows to improve crawl/ scrape analysis, reports, and data management. We will rely on you to test the data and the scrape to ensure accuracy and quality. You will own the process to identify and rectify any issues with breaks and scale scrapes as needed.
Requirements
- Passionate about Data Engineering
- Confident in running large scale web scrapes
- Solid Python and JavaScript knowledge
- Familiarity with the Chrome DevTools and how to use each of its features
- Ability to work independently and juggle priorities to thrive in a fast-paced environment
- Familiarity with Linux/UNIX, HTTP, HTML, and Networking
- Good understanding of website structure and composition
- Familiarity with techniques and tools for crawling, extracting and processing
- Familiarity with system monitoring/administration tools
- Familiarity with version control, open-source practices, and code review
- Familiarity with applications designed to display archived web content
- Great communication skills (written and Spoken in English)
- Master's Degree in Computer Science or a related field or the equivalent demonstrated experience
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Business Development Associate in Lucknow, Pune, Surat, Bhopal
Beep - Internship & Job Alerts,
Surat, Gujarat
1 day ago
Key Responsibilities Engaging in direct sales activities for e-commerce services Building and maintaining relationships with potential clients Demonstrating the value and benefits of eCommerce services Negotiating contracts and closing sales deals Assisting new sellers in launching their shop on an eCommerce platform Helping sellers set up their seller accounts and profilesAbout Company: Our sole aim at MentorBoxx is to bridge...
Recruitment Consultant Internship in Surat
Ilan India,
Surat, Gujarat
1 day ago
Selected Intern's Day-to-day Responsibilities Include Candidate sourcing & outreach: Identifying potential candidates through job portals, LinkedIn, or internal databases. Screening & initial communication: Conducting preliminary calls to verify candidates’ interest, availability, and suitability. Scheduling & coordination: Scheduling interviews or meetings with shortlisted candidates. Database management: Maintaining accurate records of contacted candidates, responses, and feedback.About Company: Ilan India is a one-stop...
Fullstack Developer
Araneux Systems,
Surat, Gujarat
3 weeks ago
Join our dynamic team at Araneux as we build innovative solutions for our clients. We're seeking someone with at least 1 year of experience in Python / Django and ReactJS development who can help us create exceptional user experiences and scalable web applications.ResponsibilitiesDevelop and maintain robust web applications using the Django framework and ReactJS library.Collaborate with designers, developers, and project...
