Return simplified HTML subset to item descriptions #54

New issue

Open

opened 2023-07-19 22:18:08 +00:00 by skobkin · 1 comment

skobkin commented

2023-07-19 22:18:08 +00:00

Collaborator

Solve the problem of trimming posts from the end without leaving unclosed tags (#53).

After that we can return some simple subset of HTML tags to the description.

Settings before stripping all HTML:

self.html_sanitizer: Cleaner = Cleaner(
    tags=['b', 'strong', 'i', 'em', 'u', 'ins', 's', 'strike', 'del', 'tg-spoiler', 'a', 'code', 'pre'],
    attributes={"a": ["href", "title"]},
    protocols=['http', 'https'],
    strip=True,
)

Solve the problem of trimming posts from the end without leaving unclosed tags (#53). After that we can return some simple subset of HTML tags to the description. Settings before stripping all HTML: ```python self.html_sanitizer: Cleaner = Cleaner( tags=['b', 'strong', 'i', 'em', 'u', 'ins', 's', 'strike', 'del', 'tg-spoiler', 'a', 'code', 'pre'], attributes={"a": ["href", "title"]}, protocols=['http', 'https'], strip=True, ) ```

skobkin added the

enhancement

label 2023-07-19 22:18:08 +00:00

skobkin self-assigned this 2023-07-19 22:18:08 +00:00

Miroslavsckaya was assigned by skobkin

2023-07-19 22:18:08 +00:00

skobkin commented

2023-07-19 22:23:12 +00:00

Author

Collaborator

It's being said that BeautifulSoup could be used to achive this:

from BeautifulSoup import BeautifulSoup

soup = BeautifulSoup(html)
print soup.prettify("<p><ul><li>Foo")

prints:

<p>
 <ul>
  <li>
   Foo
  </li>
 </ul>
</p>

It's being said that BeautifulSoup could be used to achive this: ```python from BeautifulSoup import BeautifulSoup soup = BeautifulSoup(html) print soup.prettify("<p><ul><li>Foo") ``` prints: ```html <p> <ul> <li> Foo </li> </ul> </p> ```

skobkin referenced this issue

2023-07-19 22:24:48 +00:00

Fix #53. Temporarily (?) sanitizing all HTML tags from RSS item descriptions to avoid non-closed tags being sent to Telegram API. #55