Use pure-sasl only (including in linux)

[antoniivanov]

Hi,

I am wondering why are we not using pure-sasl on linux as well - https://github.com/cloudera/thrift_sasl/blob/master/setup.py#L36

sasl is pretty hard to install on linux. especially in environment we have not control over - e.g docker or client environment. So so it will be much easier if we can use pure-sasl, right?

Is there reason thrift-sasl depends on sasl for linux ?

[potiuk]

Hey @attilajeges - quick question, I saw that pure-sasl version released in alpha couple of hours ago. do you have any expectations about the final release date? I believe this is the last blocker for Apache Airlfow to move to Python 3.9 (old sasl library does not support it). I saw also that you prepared alpha release for the sasl version (with py39 binaries). Maybe that one will be faster?

[attilajeges]

Hi @potiuk , we don't have an ETA yet. Currently we are testing this alpha release to see how reliable / robust pure-sasl is. If everything looks good, probably we can have an official release in a couple of weeks. There are no guarantees though.

About the 0.4.3a1 alpha release with sasl wheels: One of our requirements is not to depend on g++, so releasing sasl wheels with a pre-built C++ extension was a first attempt at achieving this goal. The sasl wheels include the pre-built C++ extension and its dependencies, including libsasl2.so. The issue with this is that libsasl2.so is not portable across linux distributions (it uses different paths to find SASL authentication plugins on different OSes). This means that a sasl wheel built in a CentOS-based manylinux docker container will not work on Debian/Ubuntu. Because of this, I'd prefer to drop sasl and use pure-sasl inthrift-sasl instead.

[potiuk]

Understood. Thanks. Is there anything I can help with testing of the pure-sasl thrift_sasl? We are using thrift_sasl in our Hive integration in Apache Airflow https://airflow.apache.org/docs/apache-airflow-providers-apache-hive/stable/index.html and sasl is used with kerberos integration and I might either try to make some tests with our test harness with the new version if it is helpful.

In Airflow we have some automated tests with Airflow + Hive Provider + Kerberos + Presto/Trino + Sasl. So this might be pretty helpful I guess ?

[attilajeges]

@potiuk Thanks, any additional testing would be useful. Your help is appreciated. Note that we already found some minor issues, so there will be a new alpha release soon.

[potiuk]

Ok will wait for that and run some testing then.

[attilajeges]

@potiuk Actually, I confused thrift-sasl with impyla (which depends on thrift-sasl). We will have a new alpha release of impyla but thrift-sasl so far looks good. You can go ahead and do some testing with the current alpha 0.4.3a2. Thanks!

[csringhofer]

Since 64b723e only pure-sasl is used, so this ticket should be closed (but I have no right for that).