Activity
Mon
Wed
Fri
Sun
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Nov
Dec
What is this?
Less
More

Memberships

Data Alchemy

Public • 23.7k • Free

22 contributions to Data Alchemy
The Job Seeker project so far
It's been an eventful week! We started a community project based on the Job Seeker project pitch on our Miro Board. I've developed one or two not-so-small projects in the past, but never have I had to organise a GitHub repository with pull requests. I'm doing so now, making all the errors one can imagine. Here's the progress we made so far: 1. We made a web scraper to scrape job postings from linkedin 2. We prompted the LLM to generate skill key words for every posting Not too shabby for a first time project! There's still lots to cover, mind you: 1. Prompt the LLM to cluster the key words, as they often are too detailed 2. prompt the LLM to analyse a resume for missing keywords from the cluster list And then, a UI. Probably a web page. I imagine something like: 1. Have a set of key words for job titles we already scraped 2. If the user happens to ask for an existing job title, the LLM immediately asks for their resume 3. Otherwise, we start scraping (long process) 4. Then we generate the keywords (long process) 5. Then we generate the clusters (long process) 6. Due to the time involved for steps 3-5, this cannot be a real time process. I suspect we will have to send an email to the user. Oh no! Email servers? The road to hell is paved with good intentions... 7. Now the LLM asks for the user's resume 8. Magic happens. 9. Profit: the user hears the LLM's recommendations about which keywords to add to their resume. Want to help out? Come to our Slack channel and offer your services! ;) Thank you @Brandon Phillips , @Ana Crosatto Thomsen , @Olu Akin , Slav Petkovic (where's he gone?), @Sapnil Patel for making this fun, inspiring and who knows perhaps successful 🎉
13
11
New comment Dec '23
The Job Seeker project so far
4 likes • Dec '23
Heyya guys, you truly rock...you inspire....Cheers
The Job Seeker project and other odds and sods
Hey all, reporting back with news about our project: Ana, Brandon and I have been busy preparing the data pipeline from scraping to analysis: - scraping we search for a specific job title on LinkedIn (e.g., Data Engineer) and scrape X number of search results pages. we save the resulting data (e.g., title, location, description, etc.) into a json file with help of the pydantic module - skills extraction we prompt the LLM to extract required skills from the job descriptions. again with the help of pydantic, we save the resulting data into a json file. - skills clustering the resulting json is far too detailed to be useful, so we prompt the LLM to evaluate the skills and identify and name clusters of skills. pydantic, json, file. - data processing we have taken a first shot at processing this data: dimensionality reduction, association rule mining, network analysis. we are just at the beginning, but it's super inspiring that we got this far in our own project. it's too early to report findings, but once we find something interesting, we'll let you know :) I recommend everybody to find like-minded community members and embark on projects where you can contribute, learn and co-operate. It's motivating to know that you are on a joint endeavour. Speaking of which: thanks to Zachary, our team was able to reach out to an organisation in East Africa that helps farmers turn to organic farming. We had our first meeting yesterday and learnt so much about their objectives and the problems they face. We are brainstorming on what project we can design so we learn, collaborate and contribute. Ana is extremely talented in bringing people together and materialising opportunities. It's thanks to her enthusiasm that we got this far with the organic farming project! Over and out, back to enjoying ourselves on our self initiated projects :)
8
7
New comment Dec '23
The Job Seeker project and other odds and sods
3 likes • Dec '23
Thank you @Marco Bottaro @Ana Crosatto Thomsen for leading by example and thanks too, to the rest of the project members for giving the impetus and momentum to your efforts and am quite sure they are all ready and willing to contribute and collaborate in a broader scope and at larger scale once called upon. Thanks also to the membership of community in general for giving the same that sense of being and life coz this is where we all belong, at least in this time and juncture. So sorry i haven't been able to participate in any subsequent follow ups since that first day of the project meet. Had to attend to an accelerated kind of course in gemstones identification in Dar es salaam, Tanzania( where currently based). It was kind of abrupt as i hadn't known about it before hand and as am transitioning from being an artisanal miner(the lowest and most marginalized entity in the multibillion gemstones trade) to being a gem cutter, this opportunity came as a godsend and had to grab it at all cost as the next similar one is scheduled in a year's time from this one(now).Have just successfully finished it and now looking forward to the next level slated for Feb coming year, InshAllah. The lady who runs the lapidary school is the top in Tanzania, by all standards and got me to see and feel first cut and polished gemstones. Have never come such close to a finished gem, save from the internet pictures and all those years i have been in the mines both back home in Kenya and here have only been doing rough gemstones with no such allure and lustre. Was quite mesmerized by the brilliance and sparkle of a finished gem that i now no longer wonder why people pay so much more for such stones. Am sure ninety percent of my fellow actual miners in the field have never seen a cut gemstone and that's the sad reality considering the dire poverty and dangerous working conditions where death abounds either from collapsing pits, communicable diseases or being mauled or trampled upon by the wild game. Hope as i progress i will be able to help alleviate those conditions in one way or another no matter how humble my contribution will be. Will just do my part. Was privileged to meet like minded miners all the way from Mozambique in the class too and although they speak Portuguese with little knowledge of English am glad that ChatGpt was pivotal in our communication, though they never heard about it before. The teacher lady who has another lapidary class in Switzerland(she's married to a prominent Swiss gemologist) promised to guide us in establishing a collaborative network so that we would do a joint venture....Anyway in short that's what i have been up to but now eager to get back to coding and catching up. Thanks for engaging the organic outfit and in fact have being in touch with the IT guy there who's quite grateful and eager for the project. Coincidentally I will be spending my Christmas, God willing at the slopes of Mount Kilimanjaro where the project is located.....Anyway guys thank you so much for the love you have shown and willingness to support this needy cause....May your efforts be rewarded , your prayers answered and dreams fulfilled....may you never lack....Happy holidays full of joy and health...take care and be safe....FELIZ NAVIDAD TO YOU ALL AND YOURS TOO
How to get to Anaconda Prompt from Command Prompt
As you can see below in the top image, the Command prompt does not recognize "jupyter notebook". However when I "search" for "Anaconda" on my Windows comp, there is an "Anaconda Prompt" (second image) which DOES recognize the jupyter notebook. There should be a way to run jupyter notebook from the command prompt without having to do a search for "Anaconda prompt". My question is how to do this. Has anyone had a similar experience?
5
7
New comment Dec '23
How to get to Anaconda Prompt from Command Prompt
4 likes • Dec '23
@Michael Wander Maybe this can help https://freelearning.anaconda.cloud/jupyter-notebook-basics
2 likes • Dec '23
@Michael Wander This will kind of sort you out https://docs.anaconda.com/free/navigator/index.html
I’m finding it difficult to see navigate the site, I can’t find the coursea
I’m finding difficult to navigate the site, I can’t find the courses
5
2
New comment Dec '23
3 likes • Dec '23
@Okwuchukwu Ezaka Welcome to the community but however courses here unlock through a levelling system where your interaction and contribution to the community will amass you sufficient points to get you to the next level.Just share anything you think is worthy,links , stories,gains ... just anything as long as it got decorum... the more like it will get the more points for you...It doesn't have to go viral just a point on this and that to show you're actively involved and you'll be unlocking content in no time..... like others posts too and build a rapport to simply engage...
Key Tips from a Google Software Engineer
Today, I wanted to share a LinkedIn post that I found interesting. It's from a Software Engineer at Google who shares five things he wishes he knew when he started learning programming, and I think it's spot on. 1. Your growth will not be linear. 2. There's no "best" technology. 3. Learning is the only constant. 4. GitHub is your best friend. 5. Quality over Quantity. Here is the link to his post. Happy learning! 😁
12
2
New comment Dec '23
2 likes • Dec '23
@Ana Crosatto Thomsen Food for thought....I concur too
1-10 of 22
Zachary Mwarari
5
272points to level up
@zachary-mwarari-8071
An agriprenuer and organic farmer

Active 53d ago
Joined Nov 12, 2023
INFJ
Tanzania
powered by