471,071 Members | 1,000 Online
Bytes | Software Development & Data Engineering Community
Post +

Home Posts Topics Members FAQ

Join Bytes and contribute your articles to a community of 471,071 developers and data experts.

Slack Automation Sample - Scraping contact list from one channel

Background
Recently, I to monitor contact info of some slack channels, but I don't have API to invoke. So I need use UI Automation to finish this task.
I found this library recently Clicknium, besides support web automation like selenium, it also supports desktop automation, that is useful for me.
You can follow the getting started of this Visual Studio Code extension to setup environment, less than 2 minutes for me.

Slack client automation - Scraping the contact list
  • Auto select group and channel.
based on group name, auto click on the left navigation bar:



I use Clicknium Recorder to record the UI element on slack, and update it with parameter {{group}} as the following, for parametric locator, please refer to Clicknium Document



I set the title of the windows to 'Slack*', as clicknium support wild char to match, it can improve the automation robust.
And I add the tabitem name to parameter 'group', then I can sepecify group in running stage.

Expand|Select|Wrap|Line Numbers
  1. from clicknium import clicknium as cc, locator, ui
  2.  
  3. ui(locator.slack.tabitem_group, {'group':group}).click()
  • In similar way to auto click channel.
Expand|Select|Wrap|Line Numbers
  1. if not cc.is_existing(locator.slack.treeitem_channel, params):
  2.         ui(locator.slack.treeitem_parent).click()
  3.     ui(locator.slack.treeitem_channel, params).click()
As sometimes channel list is collapsed, so I check the target channel is existing or not, if not, need click the Channels to elapse the channel list first.


  • get the contact count by get the text of the info at the right-top, then parse the text.



Expand|Select|Wrap|Line Numbers
  1. text = ui(locator.slack.text_all, params).get_text()
  2. index = text.find("members")
  3. count = int("".join(re.findall("\d+",text[0:index])))
  • Show the contact list dialog by clicking the info at the right-top.


  • as the contact list is dynamic loaded, so we scrape almost 10 items, need page down the scroll bar to load new contacts

Expand|Select|Wrap|Line Numbers
  1. for i in range(1,13):
  2.     dict = {"index":i}
  3.     if not cc.is_existing(locator.slack.listitem_member, dict):
  4.         continue
  5.     elem_member = ui(locator.slack.listitem_member, dict)
  6.     name = elem_member.get_text()
  7.     if NotContains(names, name):
  8.         names.append({'name':name,'email':'', 'postfix':''})
  9.         step += 1
  10.         if step % 100 == 0:
  11.             SaveToFile(names)
  12.  
  13. ## move mouse down to trigger new data loaded for member list
  14. ui(locator.slack.edit_membername).click(by='mouse-emulation')
  15. for i in range(10):
  16.     cc.send_hotkey("{DOWN}")

I click the find members edit box and then send the hotkey 'Down' for ten times, it will trigger to load new contacts.
To scrap each member name, I use the following parametric locator:




Slack client automation - Scraping the contact detail
In above section, I show how to Scraping contact list from a channel, in this section, I show how to Scraping each contact detail information, such as email address. (If the channel don't show the email address, you can skip this section).
  • Same as the above section to auto select group and channel.
  • Show the contact list dialog by clicking the info at the right-top.
  • Input the contact name to search the contact

Expand|Select|Wrap|Line Numbers
  1. ui(locator.slack.text_all, params).click()
  2. ui(locator.slack.edit_membername).set_text(item['name'], "set-text")
  • If matched, click to show profile of the contact, and then get the text of email

To click the search result, I use the following locator,
set the name with parameter 'name' and uncheck listitem layer.


  • Error handling in this section:
- If search failed, need close the dialog and iterate to next contact.
- If cannot get the email info, need close the profile tab and iterate to next contact.

Expand|Select|Wrap|Line Numbers
  1. member1 = cc.wait_appear(locator.slack.listitem_member1, {'name':item['name']})
  2. if member1 != None:
  3.     member1.click()
  4. else:
  5.     print("failed to search the member")
  6.     item['email'] = "ignore"
  7.     item['postfix'] = ""
  8.     ui(locator.slack.image).click()
  9.     continue
  10.  
  11. try:
  12.     email = ui(locator.slack.text_email).get_text(timeout=5)
  13.     item['email'] = email
  14.     item['postfix'] = email.split('@')[1]
  15. except:
  16.     print("failed to find the email")
  17.     item['email'] = "ignore"
  18.     item['postfix'] = ""
  19.     if cc.is_existing(locator.slack.image):
  20.         ui(locator.slack.image).click()
  21.         continue
Open Source Code
I put the code in my github, if you need view full code, please refer to github.
2 Weeks Ago #1
0 7388

Post your reply

Sign in to post your reply or Sign up for a free account.

Similar topics

1 post views Thread by Robert J. Bonn | last post: by
1 post views Thread by rjbonn | last post: by
reply views Thread by Robert J. Bonn | last post: by
3 posts views Thread by d3ph03n1x | last post: by

By using Bytes.com and it's services, you agree to our Privacy Policy and Terms of Use.

To disable or enable advertisements and analytics tracking please visit the manage ads & tracking page.