Eric Appsumo - Customer Support Thread

OK? Part two of extracting and scraping the data we need from each individual realtor.

So I already went to see view part one video to view to see how I scraped um the individual realtor and extracted DRL links from realtor dot com.

So that's part one.

And then I'm gonna connect this sheet to a second automation to go into each uh to go into each URL and get the data that I need.

OK? So let's see here.

This is part one.

Let me build a part two.

Yeah.

And what I'm gonna do is just go to actually, I'm just gonna use the URL right from here.

So I can use the first one to record my steps and then I can schedule and repeat it and have it loop through.

All right.

So let's say I need, what do I need? I need phone number, I need website.

I need name, right? So what I wanna do is make sure that I mil or great test number two.

So I wanna make sure that my headers are organized the way I want them to.

So let's go with, let's go with name, right? So I wanna make sure I get the name here.

Yeah.

Um I don't know what this is.

Maybe his realtor number.

I'm not in realtor real estate, so, uh, that sounds bad.

All right.

Phone number, license number, if that probably is, uh, I could scrape this data if I wanted to.

What else do we need here? Need? What website it's like, uh, I don't see an email on here.

So if that's the case, if you need an email, then make sure you pull up a URL that includes an email with contact information, information on here.

You can also extract all of this if you need to Facebook website.

Ok, then, or you can email him in here.

Got it.

You could also e automatically email every one of these people individually by making sure you have data in your sheet and then recording yourself emailing one person, then setting that up with a loop through data, trigger and extracting and pulling data from the sheet to enter into here and it'll pull the, the variable.

So that's another option but not to go on a tangent here.

All right.

So I'm gonna have what I need.

So I got name.

So let me go to scrape text because it's not a um list.

So I'm going to create text.

I grab my scrape text.

I'm gonna go to uh realtor number, scrape text again, not getting a list.

So grab that one.

I'm gonna get the phone number, mobile number.

It's I know if it matters, you can play around with it if you need a different number, scrape website.

Ok.

And I don't know, I didn't give me an A URL option.

So I wanted the URL option for that.

But if there's UR option there to extract, it'll pop up.

So that's pretty much all I need all around you.

So part two to filter.

All right.

So what I'm gonna do here is set up a trigger so I can connect my sheet.

So yes, this time I'm going to connect the sheet and what I wanna do is connect this sheet that has all of my LS in it.

And let's go, it's gonna pull from here, which is good.

Um I'm gonna have it start off on row two, row two is five, have a group two or three people.

And if I wanted to schedule this to automatically run, I can do that before I mess around with my steps.

I need to make sure that these OK, these have headers in them.

And then what I'm gonna do is scrape this data here and send to this Google sheets with this time or she oh, here's, here's what it is.

I can't have any special characters in here.

So that's why it's showing me I need headers in it.

I'm gonna delete rep paste.

Not sure.

Yeah, there we are.

So we are gonna be adding an update where we will say, hey, we can't include any special characters.

All right.

So I have all my scrapes of what I need.

You can even re scrape, you can even rename these.

So, scraped, scrape a great whatever that number is.

Phone number and website.

All right, cool.

So I'm gonna at least test this.

I'm gonna have a loop through three and we'll see how it works.

And if I, I'm gonna play test or play up to test it, if it doesn't work the way I want it to, then I'm just going to keep uh adding steps, add delays.

If I need to add filters, if I need to, until I get this to do what I needed to do currently on step two.

Oh What am I doing here? So I've been working a lot.

OK? So I need to uh shoot, I need to add in a navigate step.

So I'm gonna have to recapture this.

So this navigate step so I can attach the, the URL S I need to add and navigate stuff.

So let me recapture.

It's part of the process of building automation.

Sometimes you skip some of the simplest steps.

Let me go to um I need to add some extra clicks in here real clear dot com.

And let me just click on find realtors.

There we go.

So then I'm going to repeat the process.

Yeah.

So again, I wanna get the name, first script name.

Great.

The filter number, scrape the phone number, scrape the website.

So it, there should be a URL to extract from this.

This would be a good bug report in uploading or in our bug report.

So you can report, hey, I'm clicking on this element to script text and I'm not getting a, a URL option so we can take a look at the site and add what whatever we need to add to, to a craving teacher.

Ok.

This is done.

Now, now see, see where I have find realtors.

What I'm gonna do now, since I recapture, I don't need to connect my sheets and send to you anymore because they were already connected and I used to recapture.

So I'm gonna add a URL step.

And what I'm going to do here is connect header one because that's where all of my URL S are right? Then I'm going to delete my first click.

So what it's gonna do is navigate then scrape, scrape name, scrape number, escape phone number, et cetera.

I wanted to loop from beginning to end.

So let's test this.

It's going to loop and start on five because I triggered it once.

So let me we uh past another right.

Here we go.

All right, you were browsing something made us think you might be a Bob.

There's a few reasons you might power using these websites.

You can be, you got a javascript.

OK? Press and hold, I'm gonna press and hold this for right now and see if I can get through this and see if that navigates.

Here we go.

So now that it's, it's gotten familiar with what I'm doing, it's gonna work now.

Uh Step six of route one.

Right.

Let me, I'm gonna close and restart this real quick.

So it's gonna start in a different loop.

That's OK.

A different row of the sheet.

Yeah, there we go.

Now it's finding these elements.

Cool.

So I should finish on this loop three and paste data data here.

Cool.

That is complete.

And so I have this data.

I did want the URL here.

So I'm gonna report this as a bug and feel free to upload it in our product road map.

So I'm gonna report that as a bug here shortly.

Feel free to upload that if you run into the same challenge.

But yeah, good to go.

So it's part one, part two

All right.

Video number two for uh building a use case to create uh realtor information off of realtor dot com or Zillow.

So let me help out with this.

All right.

So let me go to log in the desktop app.

Let me get to the right workspace here to start building and I'm going to click admin automation.

So I think I believe you're gonna want to build this into two different emails or two different uh automation if you're trying to extract individual data for each, each realtor.

So let me just go to realtor dot com and I don't know how to get to the realtors find realtors.

I wanna go here.

You could go to the agents in 97005 search.

OK.

So if there are URL S that we can extract, we, we should be able to extract those URL S from these people.

So you want the, you probably want the individual realtor information, I'm assuming.

So you want some data in here.

OK.

Good to know.

All right.

So we're gonna wanna split this up into two different automation.

The first automation is going to be individually scraping the and extract.

Oh, sorry, not scraping, but extracting the URL of each one of these realtors.

So I just need to find where that URL is.

Usually it's in the name.

So what I'm gonna do is I'm gonna go to scrape list, create a list hover over the name and because it's a list, I wanna select two names in a row.

Well, my, I'm gonna pause here really quick.

OK.

So what I wanna do is this a repeat here? I'm gonna click scrape list and I want to extract the URL.

So I'm hoping there is a URL here.

OK? Perfect.

There is.

So what I'm gonna do is select the URL if this page has page, which it does.

OK? Then I also want, I also want to collect the, the next step.

So it's either gonna be one, either one of these here.

So let me just do this.

I'm gonna do, I'm gonna do both.

I'm gonna capture both just in case one of them works better.

God, I don't know.

OK? Let me, I'll explain my thinking here.

I don't want to just skip past the page.

So I'm gonna delete the last click step.

So I think I believe this first quick step was going to be enough.

And then I now have the skeleton.

So scraping built to com, I now have the skeleton of my automation.

So it's gonna go to uh realtor dot com.

Click find filters, uh click the the zip code and then it's going to or type search scrape links and then click the next button.

So what I would do see here with realtor dot com, I can have it navigate directly to a specific page, right? So I can do this in a separate browser.

I can go to find realtors say if I wanted to find realtors just in my area and to clean this up.

So what I'm gonna do is I'm gonna copy this URL and then I'm gonna include this URL stub.

I wanted to navigate directly to here rather than having to click, find agents and whatnot.

So I'm gonna delete all of these other steps.

So I hope this helps.

Um I could extract all of these, these URL S put them into a sheet and then connect the sheet and have it loop to each one of them.

I could do that too.

Keep this simple.

I'm gonna have to send data to, yeah, I need to make sure I have headers um to have and I'm gonna connect the sheets to this automation.

So I make sure it sends the data here dot com.

Screen test.

Found my headers.

Good to go step two.

OK? Now I do want to add a scroll down step.

So because I wanna make sure I grab everybody, it loads everybody on the page.

So what I'm gonna do is go to custom scroll down, say have it scroll down for four seconds just in case.

And then this is good to go.

So I'm gonna quick play ups and so this should be pasting data to this sheet here.

This is part one.

So then once I have all of the URL S, by the way, I could have done two scrape tests, one of them could have been extracting the URL and the second scrape list could have been uh uh scraping their name.

So I know who that URL is connected with.

But for this purpose, I just made it simple.

This automation to toto video made it simple.

Cool.

OK.

So I didn't get a chance to see what I was reading there.

It was probably detecting something with a bot.

But anyway, we do have um all of the realtors here.

OK.

Now, if I wanted this to scrape multiple pages, what I would, what I will do is clear it up, click, set up trigger and then I am going to uh use a loop through trigger.

I'm not gonna attach a sheet unless you wanna attach a sheet with URL.

S and I want it to loop through and I want to loop through say 10 pages of extracting realtors.

I can schedule it to run automatically if I want to.

And what I want this to do is is loop from step 1 to 4, 10 times.

So that's the way you want to do that.

This is part one of uh scraping the details that you need.

I'll record part two here in SEC